SecurityITest.TestJwtMiniCluster: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.3.6.62:33135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260928 13:03:19.008262  8280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.992067 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.3.6.62:33135)
0928 13:03:18.992120 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.992123 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.992256 (+   133us) server_negotiation.cc:407] Connection header received
0928 13:03:18.992336 (+    80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.992337 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.992349 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.992434 (+    85us) server_negotiation.cc:226] Negotiated authn=JWT
0928 13:03:18.992584 (+   150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.993368 (+   784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.994140 (+   772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.994463 (+   323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.994533 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:18.994735 (+   202us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 13:03:19.007404 (+ 12669us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0928 13:03:19.008200 (+   796us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59264: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260928 13:03:19.008313  8280 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59264: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
I20260928 13:03:19.008315  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8210
2026-09-28T13:03:19Z chronyd exiting
I20260928 13:03:19.043949  3096 test_util.cc:175] -----------------------------------------------
I20260928 13:03:19.044078  3096 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0

[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN      ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:02:56 dist-test-slave-ddvw krb5kdc[3103](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:02:56 dist-test-slave-ddvw krb5kdc[3103](info): set up 2 sockets
Sep 28 13:02:56 dist-test-slave-ddvw krb5kdc[3103](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260928 13:02:57.485486  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.038s	user 0.005s	sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:02:57 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:02:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:02:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:02:57.606010  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42651
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42651
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:57.686487  3116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:57.686699  3116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:57.686721  3116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:57.687834  3116 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:02:57.687870  3116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:57.687885  3116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:57.687898  3116 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:02:57.687911  3116 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:02:57.689283  3116 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42651
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:57.689482  3116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:57.689648  3116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:02:57.694945  3124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:57.695041  3116 server_base.cc:1034] running on GCE node
W20260928 13:02:57.694967  3121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:57.694969  3122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:57.695422  3116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:57.695776  3116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:57.697007  3116 hybrid_clock.cc:648] HybridClock initialized: now 1790600577696974 us; error 48 us; skew 500 ppm
Sep 28 13:02:57 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600577, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:57.699896  3116 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:02:57.700423  3116 webserver.cc:460] Webserver started at http://127.3.6.62:45633/ using document root <none> and password file <none>
I20260928 13:02:57.700654  3116 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:57.700724  3116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:57.700879  3116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:57.701990  3116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "9dd1537e343c44f89b96d989d82971bf"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "2b9fc55ed85a4c5031aaaf8e4430665f"
server_key_iv: "cf8c9bd944bf5090d2ba2b3340396c32"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.702375  3116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "9dd1537e343c44f89b96d989d82971bf"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "2b9fc55ed85a4c5031aaaf8e4430665f"
server_key_iv: "cf8c9bd944bf5090d2ba2b3340396c32"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.703833  3116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:02:57.704643  3131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:57.704831  3116 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:02:57.704936  3116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "9dd1537e343c44f89b96d989d82971bf"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "2b9fc55ed85a4c5031aaaf8e4430665f"
server_key_iv: "cf8c9bd944bf5090d2ba2b3340396c32"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.705036  3116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:57.731959  3116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:57.734488  3116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:57.734671  3116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:57.739259  3116 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42651
I20260928 13:02:57.739305  3183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42651 every 8 connection(s)
I20260928 13:02:57.739964  3116 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:02:57.741015  3184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:02:57.740990  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3116
I20260928 13:02:57.741098  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:02:57.741875  3096 external_mini_cluster.cc:1428] Setting key 01b5ef74f270667a1b8085a46e1a4c75
I20260928 13:02:57.744203  3184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf: Bootstrap starting.
I20260928 13:02:57.744910  3184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf: Neither blocks nor log segments found. Creating new log.
I20260928 13:02:57.745231  3184 log.cc:824] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf: Log is configured to *not* fsync() on all Append() calls
I20260928 13:02:57.745975  3184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf: No bootstrap required, opened a new log
I20260928 13:02:57.748541  3184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } }
I20260928 13:02:57.748704  3184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:02:57.748731  3184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dd1537e343c44f89b96d989d82971bf, State: Initialized, Role: FOLLOWER
I20260928 13:02:57.748867  3184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } }
I20260928 13:02:57.748939  3184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:02:57.748961  3184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:02:57.749032  3184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:02:57.749552  3184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } }
I20260928 13:02:57.749666  3184 leader_election.cc:302] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9dd1537e343c44f89b96d989d82971bf; no voters: 
I20260928 13:02:57.749845  3184 leader_election.cc:288] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:02:57.749868  3189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:02:57.749975  3189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [term 1 LEADER]: Becoming Leader. State: Replica: 9dd1537e343c44f89b96d989d82971bf, State: Running, Role: LEADER
I20260928 13:02:57.750064  3189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } }
I20260928 13:02:57.750108  3184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:02:57.750370  3190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9dd1537e343c44f89b96d989d82971bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } }
I20260928 13:02:57.750463  3190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [sys.catalog]: This master's current role is: LEADER
I20260928 13:02:57.750682  3191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dd1537e343c44f89b96d989d82971bf. Latest consensus state: current_term: 1 leader_uuid: "9dd1537e343c44f89b96d989d82971bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9dd1537e343c44f89b96d989d82971bf" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } }
I20260928 13:02:57.750743  3191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf [sys.catalog]: This master's current role is: LEADER
I20260928 13:02:57.750838  3195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:02:57.751345  3195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:02:57.753182  3195 catalog_manager.cc:1347] Generated new cluster ID: fba912c591564865a9182a1eb9efd5ef
I20260928 13:02:57.753249  3195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:02:57 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:57.760376  3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:57.742869 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54458 (local address 127.3.6.62:42651)
0928 13:02:57.743162 (+   293us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:57.743173 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:57.743316 (+   143us) server_negotiation.cc:407] Connection header received
0928 13:02:57.746161 (+  2845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:57.746168 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:57.746216 (+    48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:57.746366 (+   150us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:57.748620 (+  2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.749739 (+  1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.751303 (+  1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.751951 (+   648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.752061 (+   110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:57.756280 (+  4219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:57.756284 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:57.756285 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:57.756295 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:57.758183 (+  1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:57.758613 (+   430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:57.758615 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:57.758615 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:57.758702 (+    87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:57.758928 (+   226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:57.758929 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:57.758929 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:57.759223 (+   294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:57.759370 (+   147us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:57.760045 (+   675us) server_negotiation.cc:299] Negotiation successful
0928 13:02:57.760174 (+   129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":82,"threads_started":1}
I20260928 13:02:57.762643  3195 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:02:57.763199  3195 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:02:57.765654  3195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9dd1537e343c44f89b96d989d82971bf: Generated new TSK 0
I20260928 13:02:57.765810  3195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:02:57.794905  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:57.905108  3210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:57.905339  3210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:57.905365  3210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:57.906595  3210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:57.906642  3210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:57.906672  3210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:02:57.908414  3210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:57.908674  3210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:57.908974  3210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:02:57.914332  3210 server_base.cc:1034] running on GCE node
W20260928 13:02:57.914361  3215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:57.914374  3218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:57.914541  3216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:57.914819  3210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:57.915091  3210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:57.916280  3210 hybrid_clock.cc:648] HybridClock initialized: now 1790600577916266 us; error 30 us; skew 500 ppm
Sep 28 13:02:57 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600577, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:57.919348  3210 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:02:57.919835  3210 webserver.cc:460] Webserver started at http://127.3.6.1:40377/ using document root <none> and password file <none>
I20260928 13:02:57.920089  3210 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:57.920162  3210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:57.920300  3210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:57.921378  3210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "b90c084546be46faa74ae5a609e133a4"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "a67db159bdfaf173d9c46a68c5993e5a"
server_key_iv: "80aecb906973f2ced27d7441d075f3bc"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.921818  3210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "b90c084546be46faa74ae5a609e133a4"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "a67db159bdfaf173d9c46a68c5993e5a"
server_key_iv: "80aecb906973f2ced27d7441d075f3bc"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.923207  3210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:02:57.924036  3225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:57.924203  3210 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:02:57.924302  3210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "b90c084546be46faa74ae5a609e133a4"
format_stamp: "Formatted at 2026-09-28 13:02:57 on dist-test-slave-ddvw"
server_key: "a67db159bdfaf173d9c46a68c5993e5a"
server_key_iv: "80aecb906973f2ced27d7441d075f3bc"
server_key_version: "encryptionkey@0"
I20260928 13:02:57.924383  3210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:57.944901  3210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:57.946978  3210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:57.947208  3210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:57.947516  3210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:02:57.947871  3210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:02:57.947942  3210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:57.947988  3210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:02:57.948019  3210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:57.954523  3210 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:43661
I20260928 13:02:57.954566  3338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:43661 every 8 connection(s)
I20260928 13:02:57.954926  3210 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:02:57.960597  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3210
I20260928 13:02:57.960678  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:02:57.960846  3096 external_mini_cluster.cc:1428] Setting key 8c579b7397d0db59f3ee4042efb31470
Sep 28 13:02:57 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600577, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:57.965440  3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:57.955736 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:34591 (local address 127.3.6.62:42651)
0928 13:02:57.955809 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:57.955812 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:57.956052 (+   240us) server_negotiation.cc:407] Connection header received
0928 13:02:57.956552 (+   500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:57.956553 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:57.956563 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:57.956633 (+    70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:57.957628 (+   995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.958124 (+   496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.959301 (+  1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.959496 (+   195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.959550 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:57.962066 (+  2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:57.962067 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:57.962068 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:57.962076 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:57.963770 (+  1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:57.964307 (+   537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:57.964308 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:57.964308 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:57.964373 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:57.964675 (+   302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:57.964675 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:57.964676 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:57.964794 (+   118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:57.964852 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:57.965258 (+   406us) server_negotiation.cc:299] Negotiation successful
0928 13:02:57.965366 (+   108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:02:57.965672  3341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:57.955718 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.3.6.1:34591)
0928 13:02:57.955905 (+   187us) negotiation.cc:107] Waiting for socket to connect
0928 13:02:57.955945 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:02:57.956457 (+   512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:02:57.956679 (+   222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:02:57.956683 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:02:57.957325 (+   642us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:02:57.957536 (+   211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:57.957541 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.958230 (+   689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.958232 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:57.959224 (+   992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:57.959227 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:57.959561 (+   334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:57.959571 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:57.959675 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:57.960202 (+   527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:02:57.960211 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:02:57.961952 (+  1741us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:02:57.963865 (+  1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:57.963873 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:57.963876 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:57.964216 (+   340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:57.964450 (+   234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:57.964451 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:57.964452 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:57.964606 (+   154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:57.964864 (+   258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:02:57.964870 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:02:57.965059 (+   189us) client_negotiation.cc:769] Sending connection context
0928 13:02:57.965194 (+   135us) client_negotiation.cc:240] Negotiation successful
0928 13:02:57.965393 (+   199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260928 13:02:57.966235  3339 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42651
I20260928 13:02:57.966349  3339 heartbeater.cc:464] Registering TS with master...
I20260928 13:02:57.966528  3339 heartbeater.cc:511] Master 127.3.6.62:42651 requested a full tablet report, sending...
I20260928 13:02:57.967228  3148 ts_manager.cc:194] Registered new tserver with Master: b90c084546be46faa74ae5a609e133a4 (127.3.6.1:43661)
I20260928 13:02:57.967856  3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:34591
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:02:57.990007  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:58.071115  3344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:58.071369  3344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:58.071408  3344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:58.072575  3344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:58.072654  3344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:58.072697  3344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:02:58.074172  3344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:58.074450  3344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:58.074695  3344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:02:58.079653  3349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:58.079694  3350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:58.079663  3352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:58.080008  3344 server_base.cc:1034] running on GCE node
I20260928 13:02:58.080264  3344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:58.080518  3344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:58.081687  3344 hybrid_clock.cc:648] HybridClock initialized: now 1790600578081676 us; error 41 us; skew 500 ppm
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:58.084196  3344 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:02:58.084681  3344 webserver.cc:460] Webserver started at http://127.3.6.2:38397/ using document root <none> and password file <none>
I20260928 13:02:58.084919  3344 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:58.084987  3344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:58.085140  3344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:58.086228  3344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "522e26252ebf48e580357ac7e8f5f147"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "258b8dd232425f72fc46f07399747be2"
server_key_iv: "9cfcf338ad01db24638eb0bc5b4cf1b8"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.086619  3344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "522e26252ebf48e580357ac7e8f5f147"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "258b8dd232425f72fc46f07399747be2"
server_key_iv: "9cfcf338ad01db24638eb0bc5b4cf1b8"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.088081  3344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:02:58.088835  3359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.089063  3344 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:02:58.089179  3344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "522e26252ebf48e580357ac7e8f5f147"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "258b8dd232425f72fc46f07399747be2"
server_key_iv: "9cfcf338ad01db24638eb0bc5b4cf1b8"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.089258  3344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:58.108940  3344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:58.110910  3344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:58.111119  3344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:58.111370  3344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:02:58.111686  3344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:02:58.111742  3344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.111783  3344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:02:58.111806  3344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.117635  3344 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:45123
I20260928 13:02:58.117684  3472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:45123 every 8 connection(s)
I20260928 13:02:58.118000  3344 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:58.124678  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3344
I20260928 13:02:58.124799  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:02:58.124979  3096 external_mini_cluster.cc:1428] Setting key 0fa1a7f818687558d66cda59b35e51c8
I20260928 13:02:58.128139  3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.118705 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:41821 (local address 127.3.6.62:42651)
0928 13:02:58.118785 (+    80us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:58.118787 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:58.119050 (+   263us) server_negotiation.cc:407] Connection header received
0928 13:02:58.119613 (+   563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:58.119614 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:58.119628 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:58.119689 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:58.120741 (+  1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.121242 (+   501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.122271 (+  1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.122473 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.122562 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.124784 (+  2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:58.124786 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:58.124786 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:58.124794 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:58.126617 (+  1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.127075 (+   458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.127076 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.127077 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.127161 (+    84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.127418 (+   257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.127419 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.127419 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.127548 (+   129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:58.127637 (+    89us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:58.127928 (+   291us) server_negotiation.cc:299] Negotiation successful
0928 13:02:58.128029 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 13:02:58.128322  3475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.118675 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.3.6.2:41821)
0928 13:02:58.118881 (+   206us) negotiation.cc:107] Waiting for socket to connect
0928 13:02:58.118932 (+    51us) client_negotiation.cc:174] Beginning negotiation
0928 13:02:58.119497 (+   565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:02:58.119773 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:02:58.119777 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:02:58.120409 (+   632us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:02:58.120603 (+   194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:58.120608 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.121340 (+   732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.121341 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:58.122159 (+   818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:58.122162 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.122560 (+   398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.122572 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:58.122709 (+   137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.123272 (+   563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:02:58.123280 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:02:58.124673 (+  1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:02:58.126724 (+  2051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:58.126730 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:58.126732 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:58.126955 (+   223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:58.127233 (+   278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:58.127234 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:58.127235 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:58.127344 (+   109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:58.127620 (+   276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:02:58.127626 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:02:58.127786 (+   160us) client_negotiation.cc:769] Sending connection context
0928 13:02:58.127890 (+   104us) client_negotiation.cc:240] Negotiation successful
0928 13:02:58.128048 (+   158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":103,"threads_started":1}
I20260928 13:02:58.128975  3473 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42651
I20260928 13:02:58.129074  3473 heartbeater.cc:464] Registering TS with master...
I20260928 13:02:58.129276  3473 heartbeater.cc:511] Master 127.3.6.62:42651 requested a full tablet report, sending...
I20260928 13:02:58.129715  3148 ts_manager.cc:194] Registered new tserver with Master: 522e26252ebf48e580357ac7e8f5f147 (127.3.6.2:45123)
I20260928 13:02:58.130138  3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:41821
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:02:58.151895  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:58.232105  3478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:58.232374  3478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:58.232416  3478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:58.233585  3478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:58.233661  3478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:58.233708  3478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:02:58.235158  3478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42651
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:58.235431  3478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:58.235672  3478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:02:58.240566  3483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:58.240631  3486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:58.240573  3484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:58.240895  3478 server_base.cc:1034] running on GCE node
I20260928 13:02:58.241081  3478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:58.241326  3478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:58.242468  3478 hybrid_clock.cc:648] HybridClock initialized: now 1790600578242445 us; error 39 us; skew 500 ppm
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:58.245011  3478 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:02:58.245493  3478 webserver.cc:460] Webserver started at http://127.3.6.3:45523/ using document root <none> and password file <none>
I20260928 13:02:58.245716  3478 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:58.245788  3478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:58.245940  3478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:58.246996  3478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "ef5f420ba9404ce7a8a55bacee4ecb7b"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "a91739fad58a34882718a219df1a0093"
server_key_iv: "16e1b1c99915bd4f56d5015d4aabb742"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.247438  3478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "ef5f420ba9404ce7a8a55bacee4ecb7b"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "a91739fad58a34882718a219df1a0093"
server_key_iv: "16e1b1c99915bd4f56d5015d4aabb742"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.248760  3478 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:02:58.249537  3493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.249758  3478 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:02:58.249861  3478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "ef5f420ba9404ce7a8a55bacee4ecb7b"
format_stamp: "Formatted at 2026-09-28 13:02:58 on dist-test-slave-ddvw"
server_key: "a91739fad58a34882718a219df1a0093"
server_key_iv: "16e1b1c99915bd4f56d5015d4aabb742"
server_key_version: "encryptionkey@0"
I20260928 13:02:58.249940  3478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:58.274528  3478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:58.277100  3478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:58.277289  3478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:58.277570  3478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:02:58.277894  3478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:02:58.277947  3478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.277988  3478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:02:58.278012  3478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:58.284024  3478 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45171
I20260928 13:02:58.284070  3606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45171 every 8 connection(s)
I20260928 13:02:58.284403  3478 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:02:58.286909  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3478
I20260928 13:02:58.287022  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:02:58.287201  3096 external_mini_cluster.cc:1428] Setting key 833d13d0ffa01ea20d328833f5302ab9
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:58.294377  3187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.285196 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54547 (local address 127.3.6.62:42651)
0928 13:02:58.285238 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:58.285240 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:58.285523 (+   283us) server_negotiation.cc:407] Connection header received
0928 13:02:58.286078 (+   555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:58.286079 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:58.286091 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:58.286142 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:58.287182 (+  1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.287944 (+   762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.289105 (+  1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.289291 (+   186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.289346 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.291490 (+  2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:58.291491 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:58.291491 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:58.291498 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:58.293031 (+  1533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.293554 (+   523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.293555 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.293556 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.293609 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.293839 (+   230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.293840 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.293840 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.293946 (+   106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:58.293995 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:58.294248 (+   253us) server_negotiation.cc:299] Negotiation successful
0928 13:02:58.294310 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:02:58.294621  3609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.285199 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.3.6.3:54547)
0928 13:02:58.285386 (+   187us) negotiation.cc:107] Waiting for socket to connect
0928 13:02:58.285424 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:02:58.285957 (+   533us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:02:58.286228 (+   271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:02:58.286232 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:02:58.286815 (+   583us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:02:58.287086 (+   271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:58.287094 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.288026 (+   932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.288027 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:58.289022 (+   995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:58.289025 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.289355 (+   330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.289364 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:58.289463 (+    99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.289973 (+   510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:02:58.289981 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:02:58.291406 (+  1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:02:58.293120 (+  1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:58.293126 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:58.293128 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:58.293479 (+   351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:58.293671 (+   192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:58.293672 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:58.293672 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:58.293783 (+   111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:58.294001 (+   218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:02:58.294005 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:02:58.294133 (+   128us) client_negotiation.cc:769] Sending connection context
0928 13:02:58.294219 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:02:58.294347 (+   128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":91,"threads_started":1}
I20260928 13:02:58.295171  3607 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42651
I20260928 13:02:58.295290  3607 heartbeater.cc:464] Registering TS with master...
I20260928 13:02:58.295485  3607 heartbeater.cc:511] Master 127.3.6.62:42651 requested a full tablet report, sending...
I20260928 13:02:58.295895  3148 ts_manager.cc:194] Registered new tserver with Master: ef5f420ba9404ce7a8a55bacee4ecb7b (127.3.6.3:45171)
I20260928 13:02:58.296283  3148 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:54547
I20260928 13:02:58.299197  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:02:58.322165  3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.314358 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55464 (local address 127.3.6.1:43661)
0928 13:02:58.314519 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:58.314525 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:58.314543 (+    18us) server_negotiation.cc:407] Connection header received
0928 13:02:58.314570 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:58.314571 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:58.314590 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:58.314693 (+   103us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:58.315282 (+   589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.316017 (+   735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.316726 (+   709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.317050 (+   324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.317109 (+    59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.319369 (+  2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:58.319380 (+    11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:58.319380 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:58.319388 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:58.321123 (+  1735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.321432 (+   309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.321435 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.321435 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.321501 (+    66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.321665 (+   164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.321666 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.321666 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.321804 (+   138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:58.321910 (+   106us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:58.321971 (+    61us) server_negotiation.cc:299] Negotiation successful
0928 13:02:58.322033 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":93,"threads_started":1}
W20260928 13:02:58.322574  3253 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55464
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3103](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:02:58.345944  3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:58.338183 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55466 (local address 127.3.6.1:43661)
0928 13:02:58.338275 (+    92us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:58.338277 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:58.338371 (+    94us) server_negotiation.cc:407] Connection header received
0928 13:02:58.338522 (+   151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:58.338523 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:58.338535 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:58.338608 (+    73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:58.339310 (+   702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.339818 (+   508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.340621 (+   803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:58.340831 (+   210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:58.340913 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:58.343345 (+  2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:58.343346 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:58.343347 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:58.343358 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:58.344730 (+  1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.345159 (+   429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.345161 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.345161 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.345218 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:58.345418 (+   200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:58.345419 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:58.345420 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:58.345531 (+   111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:58.345658 (+   127us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:58.345747 (+    89us) server_negotiation.cc:299] Negotiation successful
0928 13:02:58.345837 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260928 13:02:58.346568  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3210
I20260928 13:02:58.351362  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3344
I20260928 13:02:58.355971  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3478
I20260928 13:02:58.360373  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3116
2026-09-28T13:02:58Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizationOnListTablets (1938 ms)
[ RUN      ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3621](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3621](info): set up 2 sockets
Sep 28 13:02:58 dist-test-slave-ddvw krb5kdc[3621](info): commencing operation
krb5kdc: starting...
W20260928 13:02:59.450914  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.070s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:02:59 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:02:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:02:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:02:59.570668  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42743
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:59.653548  3634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:59.653795  3634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:59.653833  3634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:59.655093  3634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:02:59.655156  3634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:59.655179  3634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:59.655210  3634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:02:59.655236  3634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:02:59.656755  3634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:59.657027  3634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:59.657436  3634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:02:59.662544  3639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:59.662750  3634 server_base.cc:1034] running on GCE node
W20260928 13:02:59.662544  3642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:59.662631  3640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:59.663146  3634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:59.663461  3634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:59.664631  3634 hybrid_clock.cc:648] HybridClock initialized: now 1790600579664636 us; error 63 us; skew 500 ppm
Sep 28 13:02:59 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:59.667254  3634 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:02:59.667749  3634 webserver.cc:460] Webserver started at http://127.3.6.62:45137/ using document root <none> and password file <none>
I20260928 13:02:59.667937  3634 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:59.667976  3634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:59.668068  3634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:59.669090  3634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "bee425b70f8945478fd71e194004a5ed"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "4a7075a7ca726a996b4522a31e47a601"
server_key_iv: "3b5959a64b9959c172d8cfdf38c97065"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.669399  3634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "bee425b70f8945478fd71e194004a5ed"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "4a7075a7ca726a996b4522a31e47a601"
server_key_iv: "3b5959a64b9959c172d8cfdf38c97065"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.670693  3634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:02:59.671552  3649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:59.671720  3634 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:59.671850  3634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "bee425b70f8945478fd71e194004a5ed"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "4a7075a7ca726a996b4522a31e47a601"
server_key_iv: "3b5959a64b9959c172d8cfdf38c97065"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.671924  3634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:59.683609  3634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:59.685515  3634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:59.685683  3634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:59.689407  3634 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42743
I20260928 13:02:59.689512  3701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42743 every 8 connection(s)
I20260928 13:02:59.689817  3634 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:02:59.690719  3702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:02:59.693095  3702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed: Bootstrap starting.
I20260928 13:02:59.693744  3702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed: Neither blocks nor log segments found. Creating new log.
I20260928 13:02:59.694043  3702 log.cc:824] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed: Log is configured to *not* fsync() on all Append() calls
I20260928 13:02:59.694780  3702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed: No bootstrap required, opened a new log
I20260928 13:02:59.695713  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3634
I20260928 13:02:59.695786  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:02:59.695962  3096 external_mini_cluster.cc:1428] Setting key 605a5f8de05840b3416f0889346d8c2b
I20260928 13:02:59.696736  3702 raft_consensus.cc:348] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } }
I20260928 13:02:59.696920  3702 raft_consensus.cc:374] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:02:59.696954  3702 raft_consensus.cc:729] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bee425b70f8945478fd71e194004a5ed, State: Initialized, Role: FOLLOWER
I20260928 13:02:59.697078  3702 consensus_queue.cc:260] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } }
I20260928 13:02:59.697166  3702 raft_consensus.cc:388] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:02:59.697198  3702 raft_consensus.cc:482] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:02:59.697244  3702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:02:59.698222  3702 raft_consensus.cc:504] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } }
I20260928 13:02:59.698325  3702 leader_election.cc:302] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bee425b70f8945478fd71e194004a5ed; no voters: 
I20260928 13:02:59.698475  3702 leader_election.cc:288] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:02:59.698583  3707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:02:59.698709  3702 sys_catalog.cc:564] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:02:59.698733  3707 raft_consensus.cc:686] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [term 1 LEADER]: Becoming Leader. State: Replica: bee425b70f8945478fd71e194004a5ed, State: Running, Role: LEADER
I20260928 13:02:59.698819  3707 consensus_queue.cc:237] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } }
I20260928 13:02:59.699172  3707 sys_catalog.cc:455] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader bee425b70f8945478fd71e194004a5ed. Latest consensus state: current_term: 1 leader_uuid: "bee425b70f8945478fd71e194004a5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } } }
I20260928 13:02:59.699270  3707 sys_catalog.cc:458] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [sys.catalog]: This master's current role is: LEADER
I20260928 13:02:59.699179  3709 sys_catalog.cc:455] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bee425b70f8945478fd71e194004a5ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bee425b70f8945478fd71e194004a5ed" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42743 } } }
I20260928 13:02:59.699414  3709 sys_catalog.cc:458] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed [sys.catalog]: This master's current role is: LEADER
I20260928 13:02:59.699577  3715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:02:59.700258  3715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:02:59.701906  3715 catalog_manager.cc:1347] Generated new cluster ID: 416b68f9b1c7448bbf879c3f0bffd452
I20260928 13:02:59.702008  3715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:02:59 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:59.707844  3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:59.696597 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54276 (local address 127.3.6.62:42743)
0928 13:02:59.696813 (+   216us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:59.696822 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:59.696854 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:02:59.696966 (+   112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:59.696973 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:59.697029 (+    56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:59.697194 (+   165us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:59.697840 (+   646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.699280 (+  1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.700442 (+  1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.701034 (+   592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.701149 (+   115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:59.704156 (+  3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:59.704160 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:59.704160 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:59.704171 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:59.706135 (+  1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:59.706580 (+   445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:59.706582 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:59.706583 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:59.706697 (+   114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:59.706914 (+   217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:59.706915 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:59.706915 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:59.707226 (+   311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:59.707377 (+   151us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:59.707523 (+   146us) server_negotiation.cc:299] Negotiation successful
0928 13:02:59.707652 (+   129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":100,"threads_started":1}
I20260928 13:02:59.732338  3715 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:02:59.733182  3715 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:02:59.747872  3715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bee425b70f8945478fd71e194004a5ed: Generated new TSK 0
I20260928 13:02:59.748126  3715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:02:59.778235  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:02:59.879457  3728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:02:59.879683  3728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:02:59.879706  3728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:02:59.880890  3728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:02:59.880935  3728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:02:59.880992  3728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:02:59.882514  3728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:02:59.882781  3728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:02:59.883052  3728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:02:59.888291  3734 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:59.888280  3736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:02:59.888285  3733 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:02:59.888538  3728 server_base.cc:1034] running on GCE node
I20260928 13:02:59.888757  3728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:02:59.889016  3728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:02:59.890193  3728 hybrid_clock.cc:648] HybridClock initialized: now 1790600579890179 us; error 30 us; skew 500 ppm
Sep 28 13:02:59 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:02:59.892992  3728 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:02:59.893473  3728 webserver.cc:460] Webserver started at http://127.3.6.1:43281/ using document root <none> and password file <none>
I20260928 13:02:59.893736  3728 fs_manager.cc:359] Metadata directory not provided
I20260928 13:02:59.893810  3728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:02:59.893967  3728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:02:59.895128  3728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "e63efda2d2c548689702f338cfae87ab"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "578f97dad9e0542131504fe5321ff84c"
server_key_iv: "98105ba7068b8bd242d5480fc97b3dde"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.895522  3728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "e63efda2d2c548689702f338cfae87ab"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "578f97dad9e0542131504fe5321ff84c"
server_key_iv: "98105ba7068b8bd242d5480fc97b3dde"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.896947  3728 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:02:59.897776  3743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:59.897986  3728 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:02:59.898111  3728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "e63efda2d2c548689702f338cfae87ab"
format_stamp: "Formatted at 2026-09-28 13:02:59 on dist-test-slave-ddvw"
server_key: "578f97dad9e0542131504fe5321ff84c"
server_key_iv: "98105ba7068b8bd242d5480fc97b3dde"
server_key_version: "encryptionkey@0"
I20260928 13:02:59.898200  3728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:02:59.919174  3728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:02:59.921492  3728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:02:59.921675  3728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:02:59.921938  3728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:02:59.922269  3728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:02:59.922327  3728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:59.922362  3728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:02:59.922390  3728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:02:59.928396  3728 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:42729
I20260928 13:02:59.928438  3856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:42729 every 8 connection(s)
I20260928 13:02:59.928767  3728 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:02:59.934458  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3728
I20260928 13:02:59.934617  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:02:59.934835  3096 external_mini_cluster.cc:1428] Setting key 7da5bdf0f3ca7e0b1b7a65cf1835d266
Sep 28 13:02:59 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:02:59.938997  3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:59.929466 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:56267 (local address 127.3.6.62:42743)
0928 13:02:59.929518 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:02:59.929521 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:02:59.929758 (+   237us) server_negotiation.cc:407] Connection header received
0928 13:02:59.930760 (+  1002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:02:59.930761 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:02:59.930777 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:02:59.930836 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:02:59.931564 (+   728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.932080 (+   516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.933122 (+  1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.933335 (+   213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.933417 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:59.935740 (+  2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:02:59.935741 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:02:59.935742 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:02:59.935750 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:02:59.937537 (+  1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:59.937931 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:59.937933 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:59.937933 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:59.937994 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:02:59.938309 (+   315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:02:59.938310 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:02:59.938310 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:02:59.938432 (+   122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:02:59.938510 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:02:59.938839 (+   329us) server_negotiation.cc:299] Negotiation successful
0928 13:02:59.938916 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:02:59.939292  3859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:02:59.929408 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42743 (local address 127.3.6.1:56267)
0928 13:02:59.929566 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:02:59.929617 (+    51us) client_negotiation.cc:174] Beginning negotiation
0928 13:02:59.930627 (+  1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:02:59.930907 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:02:59.930912 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:02:59.931256 (+   344us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:02:59.931454 (+   198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:59.931459 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.932205 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.932206 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:59.933023 (+   817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:02:59.933026 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:02:59.933411 (+   385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:02:59.933423 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:02:59.933556 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:02:59.934115 (+   559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:02:59.934123 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:02:59.935647 (+  1524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:02:59.937627 (+  1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:59.937633 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:59.937635 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:59.937853 (+   218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:59.938063 (+   210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:02:59.938064 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:02:59.938064 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:02:59.938211 (+   147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:02:59.938515 (+   304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:02:59.938520 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:02:59.938689 (+   169us) client_negotiation.cc:769] Sending connection context
0928 13:02:59.938803 (+   114us) client_negotiation.cc:240] Negotiation successful
0928 13:02:59.938982 (+   179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":66,"threads_started":1}
I20260928 13:02:59.939961  3857 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42743
I20260928 13:02:59.940063  3857 heartbeater.cc:464] Registering TS with master...
I20260928 13:02:59.940271  3857 heartbeater.cc:511] Master 127.3.6.62:42743 requested a full tablet report, sending...
I20260928 13:02:59.940979  3666 ts_manager.cc:194] Registered new tserver with Master: e63efda2d2c548689702f338cfae87ab (127.3.6.1:42729)
I20260928 13:02:59.941696  3666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:56267
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:02:59.961728  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:00.042776  3862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:00.043104  3862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:00.043148  3862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:00.044413  3862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:00.044502  3862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:00.044548  3862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:00.046180  3862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:00.046487  3862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:00.046751  3862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:00.052440  3870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:00.052419  3868 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:00.052582  3862 server_base.cc:1034] running on GCE node
W20260928 13:03:00.052410  3867 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:00.052832  3862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:00.053124  3862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:00.054317  3862 hybrid_clock.cc:648] HybridClock initialized: now 1790600580054294 us; error 40 us; skew 500 ppm
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:00.057052  3862 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:00.057535  3862 webserver.cc:460] Webserver started at http://127.3.6.2:35423/ using document root <none> and password file <none>
I20260928 13:03:00.057770  3862 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:00.057843  3862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:00.058002  3862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:00.059223  3862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "45aaee37267e4dafa7d37b5572ff3b1e"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "e402be21b94d381460637f0407163639"
server_key_iv: "ccd0586b30448f23f74db14680af4457"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.059618  3862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "45aaee37267e4dafa7d37b5572ff3b1e"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "e402be21b94d381460637f0407163639"
server_key_iv: "ccd0586b30448f23f74db14680af4457"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.060981  3862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:00.061753  3877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.061929  3862 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:00.062036  3862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "45aaee37267e4dafa7d37b5572ff3b1e"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "e402be21b94d381460637f0407163639"
server_key_iv: "ccd0586b30448f23f74db14680af4457"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.062134  3862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:00.085862  3862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:00.088248  3862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:00.088369  3862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:00.088618  3862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:00.088954  3862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:00.088989  3862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.089011  3862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:00.089063  3862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.094583  3862 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44273
I20260928 13:03:00.094650  3990 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44273 every 8 connection(s)
I20260928 13:03:00.094998  3862 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:00.096789  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3862
I20260928 13:03:00.096895  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:00.097071  3096 external_mini_cluster.cc:1428] Setting key ce28940b9367123e4a49552e2d3c1c13
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:03:00.105575  3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.095850 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55399 (local address 127.3.6.62:42743)
0928 13:03:00.095925 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.095927 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.096145 (+   218us) server_negotiation.cc:407] Connection header received
0928 13:03:00.097277 (+  1132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.097278 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.097291 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.097348 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.098201 (+   853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.098698 (+   497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.099907 (+  1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.100248 (+   341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.100323 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.102459 (+  2136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.102461 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.102461 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.102469 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.104202 (+  1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.104580 (+   378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.104581 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.104582 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.104653 (+    71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.104887 (+   234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.104888 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.104889 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.105036 (+   147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.105120 (+    84us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.105362 (+   242us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.105445 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 13:03:00.105696  3993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.095809 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42743 (local address 127.3.6.2:55399)
0928 13:03:00.095994 (+   185us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.096036 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.097157 (+  1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.097430 (+   273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.097434 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.097802 (+   368us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:00.098110 (+   308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.098116 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.098801 (+   685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.098803 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.099774 (+   971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.099776 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.100325 (+   549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.100334 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.100435 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.100992 (+   557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:00.101001 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:00.102367 (+  1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:00.104284 (+  1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:00.104289 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:00.104290 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:00.104499 (+   209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:00.104726 (+   227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:00.104727 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:00.104727 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:00.104816 (+    89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:00.105115 (+   299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:00.105118 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:00.105235 (+   117us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.105315 (+    80us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.105425 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":96,"threads_started":1}
I20260928 13:03:00.106238  3991 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42743
I20260928 13:03:00.106359  3991 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:00.106614  3991 heartbeater.cc:511] Master 127.3.6.62:42743 requested a full tablet report, sending...
I20260928 13:03:00.107066  3666 ts_manager.cc:194] Registered new tserver with Master: 45aaee37267e4dafa7d37b5572ff3b1e (127.3.6.2:44273)
I20260928 13:03:00.107503  3666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:55399
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:00.122468  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:44945
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:00.203796  3996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:00.203982  3996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:00.204005  3996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:00.205057  3996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:00.205093  3996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:00.205118  3996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:00.206480  3996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:44945
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42743
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:00.206717  3996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:00.206894  3996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:00.211720  4001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:00.211715  4004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:00.211722  4002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:00.212044  3996 server_base.cc:1034] running on GCE node
I20260928 13:03:00.212226  3996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:00.212427  3996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:00.213581  3996 hybrid_clock.cc:648] HybridClock initialized: now 1790600580213555 us; error 26 us; skew 500 ppm
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:00.216127  3996 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:00.216563  3996 webserver.cc:460] Webserver started at http://127.3.6.3:45483/ using document root <none> and password file <none>
I20260928 13:03:00.216760  3996 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:00.216800  3996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:00.216890  3996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:00.217895  3996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "071045495af647a9985844dc5ff4b69d"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "3594da7327a8c7e0ada362d256090358"
server_key_iv: "cab2e97257405189d7c642239d1bf3d9"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.218194  3996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "071045495af647a9985844dc5ff4b69d"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "3594da7327a8c7e0ada362d256090358"
server_key_iv: "cab2e97257405189d7c642239d1bf3d9"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.219609  3996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:03:00.220328  4011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.220517  3996 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:00.220620  3996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "071045495af647a9985844dc5ff4b69d"
format_stamp: "Formatted at 2026-09-28 13:03:00 on dist-test-slave-ddvw"
server_key: "3594da7327a8c7e0ada362d256090358"
server_key_iv: "cab2e97257405189d7c642239d1bf3d9"
server_key_version: "encryptionkey@0"
I20260928 13:03:00.220681  3996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:00.230907  3996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:00.233261  3996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:00.233382  3996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:00.233590  3996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:00.233932  3996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:00.233965  3996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.234032  3996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:00.234069  3996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:00.240197  3996 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:44981
I20260928 13:03:00.240280  4124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:44981 every 8 connection(s)
I20260928 13:03:00.240633  3996 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:00.247296  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 3996
I20260928 13:03:00.247416  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:00.247671  3096 external_mini_cluster.cc:1428] Setting key 1fbef0590d82edca878948f87c232972
I20260928 13:03:00.250473  3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.241398 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:36535 (local address 127.3.6.62:42743)
0928 13:03:00.241476 (+    78us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.241478 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.241629 (+   151us) server_negotiation.cc:407] Connection header received
0928 13:03:00.242575 (+   946us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.242576 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.242587 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.242656 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.243317 (+   661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.243861 (+   544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.244856 (+   995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.245058 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.245123 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.247448 (+  2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.247450 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.247450 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.247458 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.249170 (+  1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.249597 (+   427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.249597 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.249598 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.249652 (+    54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.249936 (+   284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.249936 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.249937 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.250040 (+   103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.250090 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.250341 (+   251us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.250407 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260928 13:03:00.250798  4127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.241330 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42743 (local address 127.3.6.3:36535)
0928 13:03:00.241490 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.241531 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.242431 (+   900us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.242732 (+   301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.242735 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.242985 (+   250us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:00.243213 (+   228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.243217 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.243945 (+   728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.243946 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.244761 (+   815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.244764 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.245134 (+   370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.245153 (+    19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.245259 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.245834 (+   575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:00.245852 (+    18us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:00.247299 (+  1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:00.249258 (+  1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:00.249264 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:00.249267 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:00.249512 (+   245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:00.249763 (+   251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:00.249764 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:00.249764 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:00.249877 (+   113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:00.250100 (+   223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:00.250104 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:00.250226 (+   122us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.250311 (+    85us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.250438 (+   127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260928 13:03:00.251266  4125 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42743
I20260928 13:03:00.251384  4125 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:00.251567  4125 heartbeater.cc:511] Master 127.3.6.62:42743 requested a full tablet report, sending...
I20260928 13:03:00.251969  3666 ts_manager.cc:194] Registered new tserver with Master: 071045495af647a9985844dc5ff4b69d (127.3.6.3:44981)
I20260928 13:03:00.252314  3666 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:36535
I20260928 13:03:00.259980  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:00.267644  3706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.261588 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54278 (local address 127.3.6.62:42743)
0928 13:03:00.261676 (+    88us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.261678 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.261734 (+    56us) server_negotiation.cc:407] Connection header received
0928 13:03:00.261757 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.261757 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.261766 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.261819 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.262346 (+   527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.262828 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.263598 (+   770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.263800 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.263856 (+    56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.265041 (+  1185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.265042 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.265042 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.265049 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.266513 (+  1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.266825 (+   312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.266826 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.266826 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.266876 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.267108 (+   232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.267109 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.267109 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.267264 (+   155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.267351 (+    87us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.267520 (+   169us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.267578 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260928 13:03:00.270113  3666 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54278:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:00.271821  3666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:00.278546  4138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274343 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:44981 (local address 127.0.0.1:38084)
0928 13:03:00.274927 (+   584us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.274935 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.274974 (+    39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.275364 (+   390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.275364 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.275366 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:00.275396 (+    30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.275397 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276604 (+  1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.276605 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.277492 (+   887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.277494 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278199 (+   705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278200 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.278275 (+    75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278288 (+    13us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.278387 (+    99us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.278444 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":111,"threads_started":1}
I20260928 13:03:00.278537  4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274571 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38084 (local address 127.3.6.3:44981)
0928 13:03:00.275130 (+   559us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.275135 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.275144 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:00.275180 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.275182 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.275198 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.275251 (+    53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:00.275476 (+   225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276500 (+  1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.277580 (+  1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278092 (+   512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278194 (+   102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278259 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.278404 (+   145us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.278447 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":86,"threads_started":1}
I20260928 13:03:00.278878  4141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274591 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49046 (local address 127.3.6.2:44273)
0928 13:03:00.274766 (+   175us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.274771 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.274787 (+    16us) server_negotiation.cc:407] Connection header received
0928 13:03:00.274822 (+    35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.274823 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.274836 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.274938 (+   102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:00.275151 (+   213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276281 (+  1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.277644 (+  1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278364 (+   720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278433 (+    69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278487 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.278744 (+   257us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.278793 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":77,"threads_started":1}
I20260928 13:03:00.278903  4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274536 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42970 (local address 127.3.6.1:42729)
0928 13:03:00.274741 (+   205us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.274746 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.274847 (+   101us) server_negotiation.cc:407] Connection header received
0928 13:03:00.274926 (+    79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.274929 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.274952 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.275201 (+   249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:00.275282 (+    81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276069 (+   787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.277643 (+  1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278363 (+   720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278433 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278487 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.278785 (+   298us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.278829 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":81,"threads_started":1}
I20260928 13:03:00.279084  4137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274339 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:42729 (local address 127.0.0.1:42970)
0928 13:03:00.274792 (+   453us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.274802 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.274850 (+    48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.275064 (+   214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.275065 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.275066 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:00.275124 (+    58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.275126 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276202 (+  1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.276203 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.277539 (+  1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.277542 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278526 (+   984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278527 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.278596 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278601 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.278652 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.278701 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":11,"thread_start_us":62,"threads_started":1}
I20260928 13:03:00.278833  4136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.274339 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44273 (local address 127.0.0.1:49046)
0928 13:03:00.274575 (+   236us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.274620 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.274725 (+   105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.274943 (+   218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.274946 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.274949 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:00.275056 (+   107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.275059 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.276387 (+  1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.276388 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.277539 (+  1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.277542 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.278530 (+   988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.278531 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.278605 (+    74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.278608 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.278652 (+    44us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.278701 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":8,"thread_start_us":83,"threads_started":1}
I20260928 13:03:00.279803  4059 tablet_service.cc:1467] Processing CreateTablet for tablet 73e25f60ef4e4c898be7b104fc472cdf (DEFAULT_TABLE table=test-table [id=c2fcc8dff7624268bb51cd3a942c03cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:00.279801  3791 tablet_service.cc:1467] Processing CreateTablet for tablet 73e25f60ef4e4c898be7b104fc472cdf (DEFAULT_TABLE table=test-table [id=c2fcc8dff7624268bb51cd3a942c03cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:00.280138  3791 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73e25f60ef4e4c898be7b104fc472cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:00.280146  4059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73e25f60ef4e4c898be7b104fc472cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:00.282615  4142 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Bootstrap starting.
I20260928 13:03:00.282764  4143 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Bootstrap starting.
I20260928 13:03:00.283396  4142 tablet_bootstrap.cc:654] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:00.283315  3925 tablet_service.cc:1467] Processing CreateTablet for tablet 73e25f60ef4e4c898be7b104fc472cdf (DEFAULT_TABLE table=test-table [id=c2fcc8dff7624268bb51cd3a942c03cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:00.283495  4143 tablet_bootstrap.cc:654] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:00.283660  3925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73e25f60ef4e4c898be7b104fc472cdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:00.283962  4142 log.cc:824] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:00.284049  4143 log.cc:824] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:00.284754  4142 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: No bootstrap required, opened a new log
I20260928 13:03:00.284794  4143 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: No bootstrap required, opened a new log
I20260928 13:03:00.284822  4142 ts_tablet_manager.cc:1397] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:03:00.284862  4143 ts_tablet_manager.cc:1397] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:00.286396  4142 raft_consensus.cc:348] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.286573  4142 raft_consensus.cc:374] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:00.286617  4142 raft_consensus.cc:729] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e63efda2d2c548689702f338cfae87ab, State: Initialized, Role: FOLLOWER
I20260928 13:03:00.286726  4142 consensus_queue.cc:260] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.287065  4142 ts_tablet_manager.cc:1428] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.003s
I20260928 13:03:00.287101  4143 raft_consensus.cc:348] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.287266  4143 raft_consensus.cc:374] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:00.287074  3857 heartbeater.cc:503] Master 127.3.6.62:42743 was elected leader, sending a full tablet report...
I20260928 13:03:00.287308  4143 raft_consensus.cc:729] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 071045495af647a9985844dc5ff4b69d, State: Initialized, Role: FOLLOWER
I20260928 13:03:00.287335  4146 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Bootstrap starting.
I20260928 13:03:00.287441  4143 consensus_queue.cc:260] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.287748  4125 heartbeater.cc:503] Master 127.3.6.62:42743 was elected leader, sending a full tablet report...
I20260928 13:03:00.287734  4143 ts_tablet_manager.cc:1428] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:00.288038  4146 tablet_bootstrap.cc:654] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:00.288645  4146 log.cc:824] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:00.289309  4146 tablet_bootstrap.cc:492] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: No bootstrap required, opened a new log
I20260928 13:03:00.289361  4146 ts_tablet_manager.cc:1397] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:00.290984  4146 raft_consensus.cc:348] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.291210  4146 raft_consensus.cc:374] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:00.291234  4146 raft_consensus.cc:729] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45aaee37267e4dafa7d37b5572ff3b1e, State: Initialized, Role: FOLLOWER
I20260928 13:03:00.291373  4146 consensus_queue.cc:260] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.291663  4146 ts_tablet_manager.cc:1428] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:03:00.291690  3991 heartbeater.cc:503] Master 127.3.6.62:42743 was elected leader, sending a full tablet report...
W20260928 13:03:00.345670  3992 tablet.cc:2369] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:00.429451  3858 tablet.cc:2369] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:00.466948  4150 raft_consensus.cc:482] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:00.467142  4150 raft_consensus.cc:504] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.467698  4150 leader_election.cc:288] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e63efda2d2c548689702f338cfae87ab (127.3.6.1:42729), 071045495af647a9985844dc5ff4b69d (127.3.6.3:44981)
I20260928 13:03:00.471876  4140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.468228 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55209 (local address 127.3.6.3:44981)
0928 13:03:00.468414 (+   186us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.468416 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.468424 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:00.468450 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.468451 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.468463 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.468511 (+    48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:00.468798 (+   287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.469537 (+   739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471079 (+  1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.471472 (+   393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471542 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.471551 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.471778 (+   227us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.471821 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":163}
I20260928 13:03:00.471869  3993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.467899 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:44981 (local address 127.3.6.2:55209)
0928 13:03:00.467974 (+    75us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.467989 (+    15us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.468063 (+    74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.468559 (+   496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.468560 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.468562 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:00.468692 (+   130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.468694 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.469639 (+   945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.469640 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.470919 (+  1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.470923 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.471568 (+   645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471569 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.471659 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.471662 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.471722 (+    60us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.471780 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51,"mutex_wait_us":94}
I20260928 13:03:00.471918  4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.468107 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:48057 (local address 127.3.6.1:42729)
0928 13:03:00.468166 (+    59us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.468168 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.468266 (+    98us) server_negotiation.cc:407] Connection header received
0928 13:03:00.468404 (+   138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.468406 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.468440 (+    34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.468504 (+    64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:00.468783 (+   279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.469560 (+   777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471125 (+  1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.471509 (+   384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471581 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.471590 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.471803 (+   213us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.471848 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:00.472162  4151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.467972 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:42729 (local address 127.3.6.2:48057)
0928 13:03:00.468193 (+   221us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:00.468206 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:00.468310 (+   104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:00.468512 (+   202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:00.468514 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:00.468516 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:00.468681 (+   165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.468684 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.469649 (+   965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.469650 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.470987 (+  1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:00.470990 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.471647 (+   657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.471648 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:00.471723 (+    75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.471727 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:00.472047 (+   320us) client_negotiation.cc:240] Negotiation successful
0928 13:03:00.472087 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":144,"threads_started":1}
I20260928 13:03:00.472491  4079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73e25f60ef4e4c898be7b104fc472cdf" candidate_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071045495af647a9985844dc5ff4b69d" is_pre_election: true
I20260928 13:03:00.472497  3811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73e25f60ef4e4c898be7b104fc472cdf" candidate_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e63efda2d2c548689702f338cfae87ab" is_pre_election: true
I20260928 13:03:00.472668  4079 raft_consensus.cc:2454] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45aaee37267e4dafa7d37b5572ff3b1e in term 0.
I20260928 13:03:00.472683  3811 raft_consensus.cc:2454] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45aaee37267e4dafa7d37b5572ff3b1e in term 0.
I20260928 13:03:00.472936  3881 leader_election.cc:302] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45aaee37267e4dafa7d37b5572ff3b1e, e63efda2d2c548689702f338cfae87ab; no voters: 
I20260928 13:03:00.473124  4150 raft_consensus.cc:2781] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:00.473181  4150 raft_consensus.cc:482] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:00.473203  4150 raft_consensus.cc:3037] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:00.474011  4150 raft_consensus.cc:504] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.474166  4150 leader_election.cc:288] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [CANDIDATE]: Term 1 election: Requested vote from peers e63efda2d2c548689702f338cfae87ab (127.3.6.1:42729), 071045495af647a9985844dc5ff4b69d (127.3.6.3:44981)
I20260928 13:03:00.474328  3811 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73e25f60ef4e4c898be7b104fc472cdf" candidate_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e63efda2d2c548689702f338cfae87ab"
I20260928 13:03:00.474337  4079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73e25f60ef4e4c898be7b104fc472cdf" candidate_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "071045495af647a9985844dc5ff4b69d"
I20260928 13:03:00.474418  3811 raft_consensus.cc:3037] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:00.474444  4079 raft_consensus.cc:3037] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:00.475251  3811 raft_consensus.cc:2454] T 73e25f60ef4e4c898be7b104fc472cdf P e63efda2d2c548689702f338cfae87ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45aaee37267e4dafa7d37b5572ff3b1e in term 1.
I20260928 13:03:00.475335  4079 raft_consensus.cc:2454] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45aaee37267e4dafa7d37b5572ff3b1e in term 1.
I20260928 13:03:00.475409  3881 leader_election.cc:302] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45aaee37267e4dafa7d37b5572ff3b1e, e63efda2d2c548689702f338cfae87ab; no voters: 
I20260928 13:03:00.475492  4150 raft_consensus.cc:2781] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:00.475670  4150 raft_consensus.cc:686] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [term 1 LEADER]: Becoming Leader. State: Replica: 45aaee37267e4dafa7d37b5572ff3b1e, State: Running, Role: LEADER
I20260928 13:03:00.475780  4150 consensus_queue.cc:237] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } }
I20260928 13:03:00.476742  3666 catalog_manager.cc:5495] T 73e25f60ef4e4c898be7b104fc472cdf P 45aaee37267e4dafa7d37b5572ff3b1e reported cstate change: term changed from 0 to 1, leader changed from <none> to 45aaee37267e4dafa7d37b5572ff3b1e (127.3.6.2). New cstate: current_term: 1 leader_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e63efda2d2c548689702f338cfae87ab" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 42729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45aaee37267e4dafa7d37b5572ff3b1e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "071045495af647a9985844dc5ff4b69d" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44981 } health_report { overall_health: UNKNOWN } } }
W20260928 13:03:00.491204  4126 tablet.cc:2369] T 73e25f60ef4e4c898be7b104fc472cdf P 071045495af647a9985844dc5ff4b69d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600579, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:00.508285  4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.501061 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42984 (local address 127.3.6.1:42729)
0928 13:03:00.501131 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.501133 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.501189 (+    56us) server_negotiation.cc:407] Connection header received
0928 13:03:00.501236 (+    47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.501237 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.501247 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.501298 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.501933 (+   635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.502504 (+   571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.503281 (+   777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.503463 (+   182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.503521 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.505789 (+  2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.505800 (+    11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.505800 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.505806 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.507282 (+  1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.507597 (+   315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.507599 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.507600 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.507659 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.507824 (+   165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.507825 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.507825 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.507948 (+   123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.508064 (+   116us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.508113 (+    49us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.508171 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:00.531529  4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.524341 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42988 (local address 127.3.6.1:42729)
0928 13:03:00.524451 (+   110us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.524453 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.524506 (+    53us) server_negotiation.cc:407] Connection header received
0928 13:03:00.524555 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.524556 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.524566 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.524608 (+    42us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.525186 (+   578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.525659 (+   473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.526342 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.526565 (+   223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.526622 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.528932 (+  2310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.528933 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.528933 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.528939 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.530357 (+  1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.530724 (+   367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.530725 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.530725 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.530774 (+    49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.530949 (+   175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.530950 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.530950 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.531117 (+   167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.531195 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.531398 (+   203us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.531461 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[3621](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:00.553246  4139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:00.546331 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42994 (local address 127.3.6.1:42729)
0928 13:03:00.546425 (+    94us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:00.546427 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:00.546484 (+    57us) server_negotiation.cc:407] Connection header received
0928 13:03:00.546534 (+    50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:00.546535 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:00.546546 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:00.546602 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:00.547226 (+   624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.547739 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.548439 (+   700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:00.548629 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:00.548684 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:00.550883 (+  2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:00.550884 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:00.550885 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:00.550891 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:00.552219 (+  1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.552552 (+   333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.552553 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.552553 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.552604 (+    51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:00.552774 (+   170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:00.552774 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:00.552774 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:00.552861 (+    87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:00.552932 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:00.553040 (+   108us) server_negotiation.cc:299] Negotiation successful
0928 13:03:00.553095 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260928 13:03:00.553761  3771 tablet_service.cc:2908] Rejecting scan request for tablet 73e25f60ef4e4c898be7b104fc472cdf: Uninitialized: clean time has not yet been initialized
I20260928 13:03:00.554934  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3728
I20260928 13:03:00.560446  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3862
I20260928 13:03:00.565160  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3996
I20260928 13:03:00.569710  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 3634
2026-09-28T13:03:00Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizationOnChecksum (2209 ms)
[ RUN      ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[4166](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[4166](info): set up 2 sockets
Sep 28 13:03:00 dist-test-slave-ddvw krb5kdc[4166](info): commencing operation
krb5kdc: starting...
W20260928 13:03:01.614881  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.024s	user 0.003s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:01 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:01.734279  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43513
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:43513
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:01.817516  4179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:01.817771  4179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:01.817795  4179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:01.819149  4179 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:01.819200  4179 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 13:03:01.819213  4179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:01.819227  4179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:01.819240  4179 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:01.819252  4179 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:01.820806  4179 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:43513
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:01.821074  4179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:01.821341  4179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:01.826442  4184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:01.826650  4179 server_base.cc:1034] running on GCE node
W20260928 13:03:01.826440  4185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:01.826453  4187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:01.827082  4179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:01.827427  4179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:01.828691  4179 hybrid_clock.cc:648] HybridClock initialized: now 1790600581828660 us; error 38 us; skew 500 ppm
Sep 28 13:03:01 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:01.835225  4179 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:01.835752  4179 webserver.cc:460] Webserver started at http://127.3.6.62:45945/ using document root <none> and password file <none>
I20260928 13:03:01.836004  4179 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:01.836081  4179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:01.836241  4179 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:01.837379  4179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "8aa47ee82a6d415cbaf22b64ed85868c"
format_stamp: "Formatted at 2026-09-28 13:03:01 on dist-test-slave-ddvw"
server_key: "e78d7e7ec7b05ff10f9b3d9a036de34b"
server_key_iv: "6b191a688e40d71bae2457e45ca802ba"
server_key_version: "encryptionkey@0"
I20260928 13:03:01.837793  4179 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "8aa47ee82a6d415cbaf22b64ed85868c"
format_stamp: "Formatted at 2026-09-28 13:03:01 on dist-test-slave-ddvw"
server_key: "e78d7e7ec7b05ff10f9b3d9a036de34b"
server_key_iv: "6b191a688e40d71bae2457e45ca802ba"
server_key_version: "encryptionkey@0"
I20260928 13:03:01.839326  4179 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:03:01.840211  4194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:01.840402  4179 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:01.840552  4179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "8aa47ee82a6d415cbaf22b64ed85868c"
format_stamp: "Formatted at 2026-09-28 13:03:01 on dist-test-slave-ddvw"
server_key: "e78d7e7ec7b05ff10f9b3d9a036de34b"
server_key_iv: "6b191a688e40d71bae2457e45ca802ba"
server_key_version: "encryptionkey@0"
I20260928 13:03:01.840641  4179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:01.849687  4179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:01.852159  4179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:01.852344  4179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:01.857684  4179 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:43513
I20260928 13:03:01.857767  4256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:43513 every 8 connection(s)
I20260928 13:03:01.858135  4179 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:01.858958  4257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:01.859169  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4179
I20260928 13:03:01.859277  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:01.859452  3096 external_mini_cluster.cc:1428] Setting key cda75454ed9a75db25b117b02947c961
I20260928 13:03:01.862766  4257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Bootstrap starting.
I20260928 13:03:01.863515  4257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:01.863816  4257 log.cc:824] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:01.864619  4257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: No bootstrap required, opened a new log
Sep 28 13:03:01 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600581, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:01.866767  4257 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } }
I20260928 13:03:01.867002  4257 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:01.867084  4257 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa47ee82a6d415cbaf22b64ed85868c, State: Initialized, Role: FOLLOWER
I20260928 13:03:01.867233  4257 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } }
I20260928 13:03:01.867312  4257 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:01.867336  4257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:01.867408  4257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:01.868081  4257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } }
I20260928 13:03:01.868250  4257 leader_election.cc:302] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8aa47ee82a6d415cbaf22b64ed85868c; no voters: 
I20260928 13:03:01.868458  4257 leader_election.cc:288] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:01.868485  4262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:01.868729  4257 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:01.868892  4262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [term 1 LEADER]: Becoming Leader. State: Replica: 8aa47ee82a6d415cbaf22b64ed85868c, State: Running, Role: LEADER
I20260928 13:03:01.868996  4262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } }
I20260928 13:03:01.869316  4262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } } }
I20260928 13:03:01.869481  4262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:01.870126  4263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aa47ee82a6d415cbaf22b64ed85868c. Latest consensus state: current_term: 1 leader_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8aa47ee82a6d415cbaf22b64ed85868c" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43513 } } }
I20260928 13:03:01.870294  4263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c [sys.catalog]: This master's current role is: LEADER
W20260928 13:03:01.870573  4276 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:01.870723  4276 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:01.871095  4277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:01.871306  4277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:01.872134  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:01.859977 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38842 (local address 127.3.6.62:43513)
0928 13:03:01.860138 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:01.860159 (+    21us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:01.860435 (+   276us) server_negotiation.cc:407] Connection header received
0928 13:03:01.860978 (+   543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:01.860987 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:01.861063 (+    76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:01.861224 (+   161us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:01.861906 (+   682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:01.863304 (+  1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:01.864251 (+   947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:01.864891 (+   640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:01.864998 (+   107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:01.867517 (+  2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:01.867522 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:01.867522 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:01.867541 (+    19us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:01.870015 (+  2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:01.870481 (+   466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:01.870484 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:01.870485 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:01.870594 (+   109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:01.870842 (+   248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:01.870843 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:01.870843 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:01.871170 (+   327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:01.871739 (+   569us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:01.871811 (+    72us) server_negotiation.cc:299] Negotiation successful
0928 13:03:01.871947 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260928 13:03:01.872785  4277 catalog_manager.cc:1347] Generated new cluster ID: 1ba7916bc84542be913abac40e15241d
I20260928 13:03:01.872862  4277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:01.887920  4277 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:01.888455  4277 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:01.897830  4277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Generated new TSK 0
I20260928 13:03:01.898062  4277 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:01.930462  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43513
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:02.013072  4283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:02.013271  4283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:02.013294  4283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:02.014462  4283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:02.014503  4283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:02.014523  4283 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:02.014549  4283 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:02.016052  4283 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:02.016295  4283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:02.016615  4283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:02.021828  4288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.021806  4289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.021817  4291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:02.021904  4283 server_base.cc:1034] running on GCE node
I20260928 13:03:02.022245  4283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:02.022442  4283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:02.023604  4283 hybrid_clock.cc:648] HybridClock initialized: now 1790600582023560 us; error 39 us; skew 500 ppm
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:02.026103  4283 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:02.026537  4283 webserver.cc:460] Webserver started at http://127.3.6.1:37873/ using document root <none> and password file <none>
I20260928 13:03:02.026791  4283 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:02.026863  4283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:02.027058  4283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:02.028218  4283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "436b2cf2dcbf4f3b8197fe386aa44534"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "5d8fbf0060c771080981fc0bd90e96c9"
server_key_iv: "57cdc69a14e857c5e5f89f3e44532c8f"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.028606  4283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "436b2cf2dcbf4f3b8197fe386aa44534"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "5d8fbf0060c771080981fc0bd90e96c9"
server_key_iv: "57cdc69a14e857c5e5f89f3e44532c8f"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.029945  4283 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:02.030830  4298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.031076  4283 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:02.031183  4283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "436b2cf2dcbf4f3b8197fe386aa44534"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "5d8fbf0060c771080981fc0bd90e96c9"
server_key_iv: "57cdc69a14e857c5e5f89f3e44532c8f"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.031270  4283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:02.040565  4283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:02.042469  4283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:02.042637  4283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:02.043251  4283 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:02.043300  4283 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.043334  4283 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:02.043401  4283 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:02.050673  4283 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:36327
I20260928 13:03:02.050719  4413 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:36327 every 8 connection(s)
I20260928 13:03:02.051136  4283 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:02.053485  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.043672 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:60437 (local address 127.3.6.62:43513)
0928 13:03:02.043722 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.043724 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.043983 (+   259us) server_negotiation.cc:407] Connection header received
0928 13:03:02.044558 (+   575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.044560 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.044572 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.044637 (+    65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.045370 (+   733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.045972 (+   602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.047436 (+  1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.047676 (+   240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.047772 (+    96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.050468 (+  2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.050470 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.050470 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.050478 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.052174 (+  1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.052581 (+   407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.052582 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.052583 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.052654 (+    71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.052893 (+   239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.052893 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.052894 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.053017 (+   123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.053069 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.053320 (+   251us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.053405 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:02.053576  4307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.043681 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.1:60437)
0928 13:03:02.043840 (+   159us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.043879 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.044424 (+   545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.044710 (+   286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.044713 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.045018 (+   305us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.045258 (+   240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.045265 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.046077 (+   812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.046078 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.047330 (+  1252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.047333 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.047788 (+   455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.047801 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.047929 (+   128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.048531 (+   602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.048541 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.050336 (+  1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.052254 (+  1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.052259 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.052261 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.052476 (+   215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.052728 (+   252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.052729 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.052729 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.052828 (+    99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.053065 (+   237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.053068 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.053205 (+   137us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.053285 (+    80us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.053411 (+   126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260928 13:03:02.054270  4414 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43513
I20260928 13:03:02.054391  4414 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:02.054589  4414 heartbeater.cc:511] Master 127.3.6.62:43513 requested a full tablet report, sending...
I20260928 13:03:02.055205  4210 ts_manager.cc:194] Registered new tserver with Master: 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327)
I20260928 13:03:02.055487  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4283
I20260928 13:03:02.055579  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:02.055778  3096 external_mini_cluster.cc:1428] Setting key 77a5952a4aed5b2223abd621f324bce3
I20260928 13:03:02.056161  4210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:60437
I20260928 13:03:02.061677  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.055500 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:46669 (local address 127.3.6.62:43513)
0928 13:03:02.055540 (+    40us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.055542 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.055579 (+    37us) server_negotiation.cc:407] Connection header received
0928 13:03:02.055612 (+    33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.055612 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.055623 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.055672 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.056301 (+   629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.056844 (+   543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.057584 (+   740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.057800 (+   216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.057892 (+    92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.058931 (+  1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.058932 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.058933 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.058940 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.060450 (+  1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.060848 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.060850 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.060850 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.060907 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.061128 (+   221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.061129 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.061129 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.061251 (+   122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.061326 (+    75us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.061491 (+   165us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.061574 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:02.061689  4420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.055325 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.1:46669)
0928 13:03:02.055465 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.055478 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.055532 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.055723 (+   191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.055724 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.055949 (+   225us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.056022 (+    73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.056025 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.056946 (+   921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.056947 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.057491 (+   544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.057492 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.057890 (+   398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.057893 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.057969 (+    76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.058486 (+   517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.058492 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.058814 (+   322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.060565 (+  1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.060566 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.060567 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.060755 (+   188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.060987 (+   232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.060988 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.060988 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.061048 (+    60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.061328 (+   280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.061329 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.061375 (+    46us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.061465 (+    90us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.061575 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:02.082902  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43513
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:02.162899  4423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:02.163159  4423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:02.163203  4423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:02.164373  4423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:02.164443  4423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:02.164477  4423 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:02.164518  4423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:02.165923  4423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:02.166203  4423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:02.166429  4423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:02.171576  4428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.171564  4431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.171564  4429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:02.171778  4423 server_base.cc:1034] running on GCE node
I20260928 13:03:02.171969  4423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:02.172233  4423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:02.173400  4423 hybrid_clock.cc:648] HybridClock initialized: now 1790600582173394 us; error 37 us; skew 500 ppm
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:02.176044  4423 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:02.176537  4423 webserver.cc:460] Webserver started at http://127.3.6.2:40717/ using document root <none> and password file <none>
I20260928 13:03:02.176777  4423 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:02.176853  4423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:02.176983  4423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:02.178092  4423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "8cb55a7d02db4c618d0a141fddf4bff6"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "7bd445ea77c3def983e26b9fd368c110"
server_key_iv: "d25f2611e7d0c30d1f489fd25b51d0ed"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.178472  4423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "8cb55a7d02db4c618d0a141fddf4bff6"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "7bd445ea77c3def983e26b9fd368c110"
server_key_iv: "d25f2611e7d0c30d1f489fd25b51d0ed"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.179864  4423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:03:02.180641  4438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.180819  4423 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:02.180917  4423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "8cb55a7d02db4c618d0a141fddf4bff6"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "7bd445ea77c3def983e26b9fd368c110"
server_key_iv: "d25f2611e7d0c30d1f489fd25b51d0ed"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.180999  4423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:02.213749  4423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:02.216470  4423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:02.216651  4423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:02.217278  4423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:02.217348  4423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.217396  4423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:02.217423  4423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:02.224838  4423 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:41257
I20260928 13:03:02.224895  4553 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:41257 every 8 connection(s)
I20260928 13:03:02.225281  4423 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:02.227543  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.217756 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:47399 (local address 127.3.6.62:43513)
0928 13:03:02.217832 (+    76us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.217836 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.218096 (+   260us) server_negotiation.cc:407] Connection header received
0928 13:03:02.218638 (+   542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.218640 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.218660 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.218715 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.219495 (+   780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.220005 (+   510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.221154 (+  1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.221389 (+   235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.221479 (+    90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.224408 (+  2929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.224409 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.224410 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.224417 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.226168 (+  1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.226570 (+   402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.226571 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.226572 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.226627 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.226895 (+   268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.226895 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.226896 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.227065 (+   169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.227129 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.227365 (+   236us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.227432 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:03:02.227670  4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.217768 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.2:47399)
0928 13:03:02.217951 (+   183us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.217991 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.218526 (+   535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.218793 (+   267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.218797 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.219181 (+   384us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.219384 (+   203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.219389 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.220108 (+   719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.220109 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.221022 (+   913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.221025 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.221476 (+   451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.221489 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.221624 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.222190 (+   566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.222199 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.224307 (+  2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.226248 (+  1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.226252 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.226254 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.226463 (+   209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.226714 (+   251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.226715 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.226715 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.226835 (+   120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.227125 (+   290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.227133 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.227248 (+   115us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.227334 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.227455 (+   121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":109,"threads_started":1}
I20260928 13:03:02.227957  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4423
I20260928 13:03:02.228060  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:02.228241  3096 external_mini_cluster.cc:1428] Setting key 51fe6fc05de9f4d3a9c841b5f942eb3a
I20260928 13:03:02.228237  4554 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43513
I20260928 13:03:02.228317  4554 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:02.228536  4554 heartbeater.cc:511] Master 127.3.6.62:43513 requested a full tablet report, sending...
I20260928 13:03:02.230479  4210 ts_manager.cc:194] Registered new tserver with Master: 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2:41257)
I20260928 13:03:02.230964  4210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:47399
I20260928 13:03:02.236478  4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.229293 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.2:47545)
0928 13:03:02.229438 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.229449 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.229504 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.229624 (+   120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.229625 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.229846 (+   221us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.229918 (+    72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.229926 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.230826 (+   900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.230827 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.231974 (+  1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.231976 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.232473 (+   497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.232476 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.232547 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.233105 (+   558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.233109 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.233416 (+   307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.235366 (+  1950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.235367 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.235367 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.235529 (+   162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.235746 (+   217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.235746 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.235747 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.235806 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.236187 (+   381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.236188 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.236250 (+    62us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.236324 (+    74us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.236401 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260928 13:03:02.236588  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.229403 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:47545 (local address 127.3.6.62:43513)
0928 13:03:02.229440 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.229442 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.229492 (+    50us) server_negotiation.cc:407] Connection header received
0928 13:03:02.229552 (+    60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.229553 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.229562 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.229619 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.230023 (+   404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.230716 (+   693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.232067 (+  1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.232394 (+   327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.232475 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.233521 (+  1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.233523 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.233523 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.233531 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.235273 (+  1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.235603 (+   330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.235604 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.235604 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.235674 (+    70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.235873 (+   199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.235874 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.235874 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.236097 (+   223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.236175 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.236382 (+   207us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.236464 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:02.258296  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43513
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:02.338939  4563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:02.339246  4563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:02.339295  4563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:02.340548  4563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:02.340631  4563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:02.340667  4563 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:02.340705  4563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:02.342212  4563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:02.342512  4563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:02.342765  4563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:02.348091  4568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.348091  4569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:02.348085  4571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:02.348440  4563 server_base.cc:1034] running on GCE node
I20260928 13:03:02.348631  4563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:02.348834  4563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:02.350013  4563 hybrid_clock.cc:648] HybridClock initialized: now 1790600582349995 us; error 26 us; skew 500 ppm
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:02.352553  4563 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:02.353047  4563 webserver.cc:460] Webserver started at http://127.3.6.3:38111/ using document root <none> and password file <none>
I20260928 13:03:02.353308  4563 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:02.353377  4563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:02.353519  4563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:02.354727  4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "d5f4270f64cd44008972847e927b25fc"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "0de39e7cc1de14f2edd12764d32ff96a"
server_key_iv: "2c1e9224b131a5bbc846ae91b9d491b8"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.355146  4563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "d5f4270f64cd44008972847e927b25fc"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "0de39e7cc1de14f2edd12764d32ff96a"
server_key_iv: "2c1e9224b131a5bbc846ae91b9d491b8"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.356526  4563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:02.357251  4578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.357425  4563 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:02.357523  4563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "d5f4270f64cd44008972847e927b25fc"
format_stamp: "Formatted at 2026-09-28 13:03:02 on dist-test-slave-ddvw"
server_key: "0de39e7cc1de14f2edd12764d32ff96a"
server_key_iv: "2c1e9224b131a5bbc846ae91b9d491b8"
server_key_version: "encryptionkey@0"
I20260928 13:03:02.357606  4563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:02.376420  4563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:02.378676  4563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:02.378849  4563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:02.379637  4563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:02.379709  4563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.379746  4563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:02.379773  4563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:02.386996  4563 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:39483
I20260928 13:03:02.387118  4693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:39483 every 8 connection(s)
I20260928 13:03:02.387444  4563 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:02.389674  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.380049 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:33289 (local address 127.3.6.62:43513)
0928 13:03:02.380114 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.380117 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.380353 (+   236us) server_negotiation.cc:407] Connection header received
0928 13:03:02.380842 (+   489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.380844 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.380858 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.380943 (+    85us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.381533 (+   590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.382377 (+   844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.383745 (+  1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.384090 (+   345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.384175 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.386863 (+  2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.386865 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.386865 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.386873 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.388453 (+  1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.388851 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.388852 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.388853 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.388911 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.389134 (+   223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.389134 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.389135 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.389239 (+   104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.389292 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.389547 (+   255us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.389611 (+    64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 13:03:02.389817  4587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.380023 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.3:33289)
0928 13:03:02.380218 (+   195us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.380259 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.380747 (+   488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.380996 (+   249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.380999 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.381234 (+   235us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.381422 (+   188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.381426 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.382514 (+  1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.382515 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.383666 (+  1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.383670 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.384186 (+   516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.384198 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.384337 (+   139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.384909 (+   572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.384919 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.386740 (+  1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.388529 (+  1789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.388533 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.388535 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.388760 (+   225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.388979 (+   219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.388980 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.388980 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.389074 (+    94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.389298 (+   224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.389302 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.389427 (+   125us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.389511 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.389626 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":130,"threads_started":1}
I20260928 13:03:02.390306  4694 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43513
I20260928 13:03:02.390408  4694 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:02.390591  4694 heartbeater.cc:511] Master 127.3.6.62:43513 requested a full tablet report, sending...
I20260928 13:03:02.390928  4210 ts_manager.cc:194] Registered new tserver with Master: d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483)
I20260928 13:03:02.391326  4210 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:33289
I20260928 13:03:02.393162  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4563
I20260928 13:03:02.393256  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:02.393419  3096 external_mini_cluster.cc:1428] Setting key 27c9b456ebf43ed8c7fb0d4ef905d340
I20260928 13:03:02.394299  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:02.397078  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.391406 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:53599 (local address 127.3.6.62:43513)
0928 13:03:02.391500 (+    94us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.391502 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.391510 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:02.391570 (+    60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.391571 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.391580 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.391642 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.392023 (+   381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.392455 (+   432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.393263 (+   808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.393513 (+   250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.393591 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.394555 (+   964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.394556 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.394556 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.394562 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.395961 (+  1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.396331 (+   370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.396332 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.396332 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.396387 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.396590 (+   203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.396590 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.396591 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.396683 (+    92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.396736 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.396939 (+   203us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.397018 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260928 13:03:02.397145  4700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.391347 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.3.6.3:53599)
0928 13:03:02.391454 (+   107us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.391465 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.391511 (+    46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.391670 (+   159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.391671 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.391868 (+   197us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.391928 (+    60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.391930 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.392544 (+   614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.392545 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.393121 (+   576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.393123 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.393589 (+   466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.393592 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.393698 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.394095 (+   397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.394099 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.394479 (+   380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.396031 (+  1552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.396032 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.396033 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.396256 (+   223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.396455 (+   199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.396456 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.396456 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.396523 (+    67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.396750 (+   227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.396751 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.396799 (+    48us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.396884 (+    85us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.396990 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":62,"threads_started":1}
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:02.416486  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.409824 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38850 (local address 127.3.6.62:43513)
0928 13:03:02.409899 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.409901 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.409910 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:02.409933 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.409934 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.409951 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.410000 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.410552 (+   552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.411072 (+   520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.411775 (+   703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.411950 (+   175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.412008 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.414039 (+  2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.414041 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.414041 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.414047 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.415497 (+  1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.415830 (+   333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.415832 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.415832 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.415886 (+    54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.416064 (+   178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.416064 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.416064 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.416161 (+    97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.416237 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.416319 (+    82us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.416374 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260928 13:03:02.418462  4210 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:02.420182  4210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:02.426671  4712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422625 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36327 (local address 127.0.0.1:39592)
0928 13:03:02.422935 (+   310us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.422943 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.422982 (+    39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.423224 (+   242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.423226 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.423229 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.423292 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.423294 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424222 (+   928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.424223 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.425405 (+  1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.425408 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426323 (+   915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426324 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.426436 (+   112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426452 (+    16us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.426524 (+    72us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.426589 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":85,"threads_started":1}
I20260928 13:03:02.426734  4714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422580 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.3.6.2:41257)
0928 13:03:02.422755 (+   175us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.422758 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.422891 (+   133us) server_negotiation.cc:407] Connection header received
0928 13:03:02.423170 (+   279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.423173 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.423187 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.423239 (+    52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.423479 (+   240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424596 (+  1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.425711 (+  1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426194 (+   483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426325 (+   131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426402 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.426578 (+   176us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.426617 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":78,"threads_started":1}
I20260928 13:03:02.426843  4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422522 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38708 (local address 127.3.6.3:39483)
0928 13:03:02.422688 (+   166us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.422693 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.422899 (+   206us) server_negotiation.cc:407] Connection header received
0928 13:03:02.423048 (+   149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.423051 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.423070 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.423161 (+    91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.423482 (+   321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424563 (+  1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.425756 (+  1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426456 (+   700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426562 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426613 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.426718 (+   105us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.426753 (+    35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
I20260928 13:03:02.426826  4715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422439 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:39483 (local address 127.0.0.1:38708)
0928 13:03:02.422794 (+   355us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.422826 (+    32us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.422918 (+    92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.423319 (+   401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.423320 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.423322 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.423397 (+    75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.423398 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424655 (+  1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.424656 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.425688 (+  1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.425690 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426563 (+   873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426564 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.426643 (+    79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426647 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.426704 (+    57us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.426742 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":4,"thread_start_us":53,"threads_started":1}
I20260928 13:03:02.427225  4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422787 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39592 (local address 127.3.6.1:36327)
0928 13:03:02.422982 (+   195us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.422987 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.423060 (+    73us) server_negotiation.cc:407] Connection header received
0928 13:03:02.423099 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.423101 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.423117 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.423189 (+    72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.423375 (+   186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424113 (+   738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.425474 (+  1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426224 (+   750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426296 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426355 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.427082 (+   727us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.427131 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":80,"threads_started":1}
I20260928 13:03:02.427268  4711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.422463 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41257 (local address 127.0.0.1:45392)
0928 13:03:02.422800 (+   337us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.422832 (+    32us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.423072 (+   240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.423323 (+   251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.423324 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.423325 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.423398 (+    73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.423399 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.424682 (+  1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.424683 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.425620 (+   937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.425623 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.426429 (+   806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.426430 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.426489 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.426492 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.426538 (+    46us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.427185 (+   647us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":520,"thread_start_us":81,"threads_started":1}
I20260928 13:03:02.427850  4628 tablet_service.cc:1467] Processing CreateTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 (DEFAULT_TABLE table=test-table [id=00432c775d594ea983bceb3b061c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.427848  4348 tablet_service.cc:1467] Processing CreateTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 (DEFAULT_TABLE table=test-table [id=00432c775d594ea983bceb3b061c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.428076  4488 tablet_service.cc:1467] Processing CreateTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 (DEFAULT_TABLE table=test-table [id=00432c775d594ea983bceb3b061c10d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.428220  4628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e10c0253be6460e9eb9a49c19fd3210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.428220  4348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e10c0253be6460e9eb9a49c19fd3210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.428465  4488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e10c0253be6460e9eb9a49c19fd3210. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.431336  4717 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Bootstrap starting.
I20260928 13:03:02.431838  4719 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Bootstrap starting.
I20260928 13:03:02.432039  4718 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Bootstrap starting.
I20260928 13:03:02.432072  4717 tablet_bootstrap.cc:654] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.432394  4717 log.cc:824] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:02.432513  4719 tablet_bootstrap.cc:654] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.432866  4719 log.cc:824] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:02.432988  4718 tablet_bootstrap.cc:654] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.433327  4718 log.cc:824] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:02.433653  4719 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: No bootstrap required, opened a new log
I20260928 13:03:02.433728  4719 ts_tablet_manager.cc:1397] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:02.434012  4718 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: No bootstrap required, opened a new log
I20260928 13:03:02.434077  4717 tablet_bootstrap.cc:492] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: No bootstrap required, opened a new log
I20260928 13:03:02.434092  4718 ts_tablet_manager.cc:1397] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:02.434134  4717 ts_tablet_manager.cc:1397] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.000s
I20260928 13:03:02.435640  4718 raft_consensus.cc:348] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.435810  4718 raft_consensus.cc:374] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.435853  4718 raft_consensus.cc:729] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f4270f64cd44008972847e927b25fc, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.435784  4719 raft_consensus.cc:348] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.435942  4719 raft_consensus.cc:374] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.435976  4719 raft_consensus.cc:729] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436b2cf2dcbf4f3b8197fe386aa44534, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.435956  4718 consensus_queue.cc:260] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.436129  4719 consensus_queue.cc:260] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.436199  4718 ts_tablet_manager.cc:1428] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:02.436131  4717 raft_consensus.cc:348] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.436271  4717 raft_consensus.cc:374] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.436329  4717 raft_consensus.cc:729] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb55a7d02db4c618d0a141fddf4bff6, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.436312  4694 heartbeater.cc:503] Master 127.3.6.62:43513 was elected leader, sending a full tablet report...
I20260928 13:03:02.436381  4719 ts_tablet_manager.cc:1428] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:02.436431  4717 consensus_queue.cc:260] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.436487  4414 heartbeater.cc:503] Master 127.3.6.62:43513 was elected leader, sending a full tablet report...
I20260928 13:03:02.436681  4717 ts_tablet_manager.cc:1428] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:02.436718  4554 heartbeater.cc:503] Master 127.3.6.62:43513 was elected leader, sending a full tablet report...
I20260928 13:03:02.463913  4725 raft_consensus.cc:482] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:02.464103  4725 raft_consensus.cc:504] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.464517  4725 leader_election.cc:288] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483), 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327)
I20260928 13:03:02.468758  4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.464682 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:39483 (local address 127.3.6.2:58031)
0928 13:03:02.464969 (+   287us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.464981 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.465037 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.465253 (+   216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.465254 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.465257 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.465332 (+    75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.465334 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.466320 (+   986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.466321 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.467738 (+  1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.467741 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.468479 (+   738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.468480 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.468570 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.468574 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.468623 (+    49us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.468680 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":47}
I20260928 13:03:02.468859  4726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.464828 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36327 (local address 127.3.6.2:57421)
0928 13:03:02.465134 (+   306us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.465143 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.465190 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.465399 (+   209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.465399 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.465401 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.465480 (+    79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.465481 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.466508 (+  1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.466509 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.467738 (+  1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.467741 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.468532 (+   791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.468533 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.468645 (+   112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.468649 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.468697 (+    48us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.468741 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":28,"thread_start_us":120,"threads_started":1}
I20260928 13:03:02.468849  4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.464907 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:57421 (local address 127.3.6.1:36327)
0928 13:03:02.464980 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.464983 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.465185 (+   202us) server_negotiation.cc:407] Connection header received
0928 13:03:02.465270 (+    85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.465271 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.465282 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.465391 (+   109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.465584 (+   193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.466415 (+   831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.467845 (+  1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.468405 (+   560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.468457 (+    52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.468467 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.468722 (+   255us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.468754 (+    32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260928 13:03:02.469133  4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.464786 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:58031 (local address 127.3.6.3:39483)
0928 13:03:02.464836 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.464866 (+    30us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.465038 (+   172us) server_negotiation.cc:407] Connection header received
0928 13:03:02.465096 (+    58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.465097 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.465112 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.465193 (+    81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.465414 (+   221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.466220 (+   806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.467816 (+  1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.468357 (+   541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.468433 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.468446 (+    13us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.469017 (+   571us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.469068 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:03:02.469201  4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e10c0253be6460e9eb9a49c19fd3210" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" is_pre_election: true
I20260928 13:03:02.469354  4368 raft_consensus.cc:2454] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 0.
I20260928 13:03:02.469506  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e10c0253be6460e9eb9a49c19fd3210" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc" is_pre_election: true
I20260928 13:03:02.469791  4440 leader_election.cc:302] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436b2cf2dcbf4f3b8197fe386aa44534, 8cb55a7d02db4c618d0a141fddf4bff6; no voters: 
I20260928 13:03:02.469952  4725 raft_consensus.cc:2781] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:02.470048  4725 raft_consensus.cc:482] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:02.470075  4725 raft_consensus.cc:3037] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.470631  4648 raft_consensus.cc:2454] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 0.
I20260928 13:03:02.471366  4725 raft_consensus.cc:504] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.471526  4725 leader_election.cc:288] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 election: Requested vote from peers d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483), 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327)
I20260928 13:03:02.471730  4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e10c0253be6460e9eb9a49c19fd3210" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436b2cf2dcbf4f3b8197fe386aa44534"
I20260928 13:03:02.471725  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e10c0253be6460e9eb9a49c19fd3210" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc"
I20260928 13:03:02.471833  4368 raft_consensus.cc:3037] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.471832  4648 raft_consensus.cc:3037] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.472800  4368 raft_consensus.cc:2454] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 1.
I20260928 13:03:02.472870  4648 raft_consensus.cc:2454] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 1.
I20260928 13:03:02.472960  4440 leader_election.cc:302] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436b2cf2dcbf4f3b8197fe386aa44534, 8cb55a7d02db4c618d0a141fddf4bff6; no voters: 
I20260928 13:03:02.473067  4725 raft_consensus.cc:2781] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:02.473209  4725 raft_consensus.cc:686] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 LEADER]: Becoming Leader. State: Replica: 8cb55a7d02db4c618d0a141fddf4bff6, State: Running, Role: LEADER
I20260928 13:03:02.473302  4725 consensus_queue.cc:237] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } }
I20260928 13:03:02.474076  4209 catalog_manager.cc:5495] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } health_report { overall_health: HEALTHY } } }
W20260928 13:03:02.476503  4555 tablet.cc:2369] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:02.489804  4714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.487361 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45394 (local address 127.3.6.2:41257)
0928 13:03:02.487403 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.487405 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.487428 (+    23us) server_negotiation.cc:407] Connection header received
0928 13:03:02.487529 (+   101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.487530 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.487548 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.487604 (+    56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:02.487739 (+   135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.488252 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.488969 (+   717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.489163 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.489217 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.489438 (+   221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.489546 (+   108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.489611 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.489650 (+    39us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.489668 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:02.491734  4368 raft_consensus.cc:1261] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Refusing update from remote peer 8cb55a7d02db4c618d0a141fddf4bff6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.491756  4648 raft_consensus.cc:1261] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Refusing update from remote peer 8cb55a7d02db4c618d0a141fddf4bff6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.492090  4725 consensus_queue.cc:1035] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.492262  4727 consensus_queue.cc:1035] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.494884  4732 mvcc.cc:205] Tried to move back new op lower bound from 7334299985882832896 to 7334299985811234816. Current Snapshot: MvccSnapshot[applied={T|T < 7334299985882832896}]
I20260928 13:03:02.496217  4731 mvcc.cc:205] Tried to move back new op lower bound from 7334299985882832896 to 7334299985811234816. Current Snapshot: MvccSnapshot[applied={T|T < 7334299985882832896 or (T in {7334299985882832896})}]
I20260928 13:03:02.498071  4211 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:02.498152  4211 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:02.498962  4211 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Sending DeleteTablet for 3 replicas of tablet 6e10c0253be6460e9eb9a49c19fd3210
I20260928 13:03:02.499279  4628 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:38708
I20260928 13:03:02.499323  4348 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39592
I20260928 13:03:02.499512  4740 tablet_replica.cc:330] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: stopping tablet replica
I20260928 13:03:02.499505  4488 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e10c0253be6460e9eb9a49c19fd3210 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:45392
I20260928 13:03:02.499635  4740 raft_consensus.cc:2229] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:02.499748  4740 raft_consensus.cc:2258] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.499791  4741 tablet_replica.cc:330] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: stopping tablet replica
I20260928 13:03:02.499733  4211 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:02.499868  4211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:02.499891  4741 raft_consensus.cc:2229] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:02.499976  4741 raft_consensus.cc:2258] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.500475  4740 ts_tablet_manager.cc:1905] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.500509  4741 ts_tablet_manager.cc:1905] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.501106  4348 tablet_service.cc:1467] Processing CreateTablet for tablet d426b464e1bc4009bab435a8ae11ff61 (DEFAULT_TABLE table=test-table [id=5ff338cd775f4b979497e5f5e642292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.501174  4488 tablet_service.cc:1467] Processing CreateTablet for tablet d426b464e1bc4009bab435a8ae11ff61 (DEFAULT_TABLE table=test-table [id=5ff338cd775f4b979497e5f5e642292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.501230  4348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d426b464e1bc4009bab435a8ae11ff61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.501281  4488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d426b464e1bc4009bab435a8ae11ff61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.502235  4628 tablet_service.cc:1467] Processing CreateTablet for tablet d426b464e1bc4009bab435a8ae11ff61 (DEFAULT_TABLE table=test-table [id=5ff338cd775f4b979497e5f5e642292e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:02.502327  4628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d426b464e1bc4009bab435a8ae11ff61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.502673  4719 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Bootstrap starting.
I20260928 13:03:02.503095  4719 tablet_bootstrap.cc:654] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.503394  4717 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Bootstrap starting.
I20260928 13:03:02.503618  4718 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Bootstrap starting.
I20260928 13:03:02.503782  4717 tablet_bootstrap.cc:654] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.504001  4718 tablet_bootstrap.cc:654] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.504802  4741 ts_tablet_manager.cc:1918] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:02.504899  4741 log.cc:1196] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/6e10c0253be6460e9eb9a49c19fd3210
I20260928 13:03:02.505134  4741 ts_tablet_manager.cc:1939] T 6e10c0253be6460e9eb9a49c19fd3210 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting consensus metadata
I20260928 13:03:02.505518  4196 catalog_manager.cc:4841] TS 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327): tablet 6e10c0253be6460e9eb9a49c19fd3210 (table test-table [id=00432c775d594ea983bceb3b061c10d5]) successfully deleted
I20260928 13:03:02.505812  4740 ts_tablet_manager.cc:1918] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:02.505890  4740 log.cc:1196] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/6e10c0253be6460e9eb9a49c19fd3210
I20260928 13:03:02.506132  4740 ts_tablet_manager.cc:1939] T 6e10c0253be6460e9eb9a49c19fd3210 P d5f4270f64cd44008972847e927b25fc: Deleting consensus metadata
I20260928 13:03:02.506289  4742 tablet_replica.cc:330] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: stopping tablet replica
I20260928 13:03:02.506397  4742 raft_consensus.cc:2229] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:02.506489  4742 raft_consensus.cc:2258] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.506964  4196 catalog_manager.cc:4841] TS d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483): tablet 6e10c0253be6460e9eb9a49c19fd3210 (table test-table [id=00432c775d594ea983bceb3b061c10d5]) successfully deleted
I20260928 13:03:02.506992  4719 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: No bootstrap required, opened a new log
I20260928 13:03:02.507066  4719 ts_tablet_manager.cc:1397] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent bootstrapping tablet: real 0.004s	user 0.000s	sys 0.001s
I20260928 13:03:02.507174  4717 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: No bootstrap required, opened a new log
I20260928 13:03:02.507215  4717 ts_tablet_manager.cc:1397] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent bootstrapping tablet: real 0.004s	user 0.001s	sys 0.000s
I20260928 13:03:02.507216  4719 raft_consensus.cc:348] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.507313  4719 raft_consensus.cc:374] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.507349  4719 raft_consensus.cc:729] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436b2cf2dcbf4f3b8197fe386aa44534, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.507360  4717 raft_consensus.cc:348] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.507398  4719 consensus_queue.cc:260] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.507436  4717 raft_consensus.cc:374] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.507457  4717 raft_consensus.cc:729] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb55a7d02db4c618d0a141fddf4bff6, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.507521  4719 ts_tablet_manager.cc:1428] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.507537  4717 consensus_queue.cc:260] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.507647  4717 ts_tablet_manager.cc:1428] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.507650  4742 ts_tablet_manager.cc:1905] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.508025  4718 tablet_bootstrap.cc:492] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: No bootstrap required, opened a new log
I20260928 13:03:02.508085  4718 ts_tablet_manager.cc:1397] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Time spent bootstrapping tablet: real 0.004s	user 0.001s	sys 0.000s
I20260928 13:03:02.508232  4718 raft_consensus.cc:348] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.508297  4718 raft_consensus.cc:374] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.508323  4718 raft_consensus.cc:729] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f4270f64cd44008972847e927b25fc, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.508358  4718 consensus_queue.cc:260] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.508436  4718 ts_tablet_manager.cc:1428] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:02.509534  4742 ts_tablet_manager.cc:1918] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:02.509627  4742 log.cc:1196] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/6e10c0253be6460e9eb9a49c19fd3210
I20260928 13:03:02.509924  4742 ts_tablet_manager.cc:1939] T 6e10c0253be6460e9eb9a49c19fd3210 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting consensus metadata
I20260928 13:03:02.510318  4197 catalog_manager.cc:4841] TS 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2:41257): tablet 6e10c0253be6460e9eb9a49c19fd3210 (table test-table [id=00432c775d594ea983bceb3b061c10d5]) successfully deleted
W20260928 13:03:02.551911  4415 tablet.cc:2369] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:02.576807  4737 raft_consensus.cc:482] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:02.576900  4737 raft_consensus.cc:504] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.577067  4737 leader_election.cc:288] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327), d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483)
I20260928 13:03:02.577307  4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d426b464e1bc4009bab435a8ae11ff61" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" is_pre_election: true
I20260928 13:03:02.577303  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d426b464e1bc4009bab435a8ae11ff61" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc" is_pre_election: true
I20260928 13:03:02.577411  4648 raft_consensus.cc:2454] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 0.
I20260928 13:03:02.577411  4368 raft_consensus.cc:2454] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 0.
I20260928 13:03:02.577569  4440 leader_election.cc:302] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8cb55a7d02db4c618d0a141fddf4bff6, d5f4270f64cd44008972847e927b25fc; no voters: 
I20260928 13:03:02.577682  4737 raft_consensus.cc:2781] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:02.577723  4737 raft_consensus.cc:482] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:02.577747  4737 raft_consensus.cc:3037] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.578421  4737 raft_consensus.cc:504] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.578548  4737 leader_election.cc:288] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 election: Requested vote from peers 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327), d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483)
I20260928 13:03:02.578732  4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d426b464e1bc4009bab435a8ae11ff61" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436b2cf2dcbf4f3b8197fe386aa44534"
I20260928 13:03:02.578737  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d426b464e1bc4009bab435a8ae11ff61" candidate_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc"
I20260928 13:03:02.578822  4648 raft_consensus.cc:3037] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.578823  4368 raft_consensus.cc:3037] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.579483  4368 raft_consensus.cc:2454] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 1.
I20260928 13:03:02.579669  4648 raft_consensus.cc:2454] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8cb55a7d02db4c618d0a141fddf4bff6 in term 1.
I20260928 13:03:02.579670  4440 leader_election.cc:302] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436b2cf2dcbf4f3b8197fe386aa44534, 8cb55a7d02db4c618d0a141fddf4bff6; no voters: 
I20260928 13:03:02.579789  4737 raft_consensus.cc:2781] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:02.579834  4737 raft_consensus.cc:686] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 LEADER]: Becoming Leader. State: Replica: 8cb55a7d02db4c618d0a141fddf4bff6, State: Running, Role: LEADER
I20260928 13:03:02.579887  4737 consensus_queue.cc:237] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.580480  4211 catalog_manager.cc:5495] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } health_report { overall_health: UNKNOWN } } }
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600581, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:02.622968  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.615919 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38854 (local address 127.3.6.62:43513)
0928 13:03:02.615989 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.615992 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.616128 (+   136us) server_negotiation.cc:407] Connection header received
0928 13:03:02.616245 (+   117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.616246 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.616260 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.616326 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.616800 (+   474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.617285 (+   485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.618012 (+   727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.618194 (+   182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.618283 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.620478 (+  2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.620480 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.620480 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.620488 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.621766 (+  1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.622160 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.622161 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.622162 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.622221 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.622418 (+   197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.622418 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.622419 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.622534 (+   115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.622613 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.622765 (+   152us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.622849 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:02.623070  4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.615850 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43513 (local address 127.0.0.1:38854)
0928 13:03:02.616033 (+   183us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.616050 (+    17us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.616145 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.616330 (+   185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.616331 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.616644 (+   313us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:02.616707 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.616709 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.617383 (+   674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.617384 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.617924 (+   540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.617925 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.618283 (+   358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.618287 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.618339 (+    52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.618931 (+   592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:02.618935 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:02.620376 (+  1441us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:02.621868 (+  1492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.621876 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.621879 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.622069 (+   190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.622290 (+   221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:02.622292 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:02.622292 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:02.622352 (+    60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:02.622603 (+   251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:02.622610 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:02.622656 (+    46us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.622744 (+    88us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.622904 (+   160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":59,"thread_start_us":87,"threads_started":1}
I20260928 13:03:02.625209  4211 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:38854:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260928 13:03:02.625407  4211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:02.626770  4348 tablet_service.cc:1467] Processing CreateTablet for tablet 1029392e5aea4a52a6c11885850753f3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ba726e46507d4038bdaf4dd6df25ae7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:02.626801  4488 tablet_service.cc:1467] Processing CreateTablet for tablet 1029392e5aea4a52a6c11885850753f3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ba726e46507d4038bdaf4dd6df25ae7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:02.626931  4348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1029392e5aea4a52a6c11885850753f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.626971  4488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1029392e5aea4a52a6c11885850753f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.628322  4717 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: Bootstrap starting.
I20260928 13:03:02.628394  4719 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: Bootstrap starting.
I20260928 13:03:02.628643  4717 tablet_bootstrap.cc:654] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.628829  4719 tablet_bootstrap.cc:654] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.629339  4717 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: No bootstrap required, opened a new log
I20260928 13:03:02.629416  4717 ts_tablet_manager.cc:1397] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:02.629388  4628 tablet_service.cc:1467] Processing CreateTablet for tablet 1029392e5aea4a52a6c11885850753f3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ba726e46507d4038bdaf4dd6df25ae7d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:02.629550  4628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1029392e5aea4a52a6c11885850753f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:02.629542  4717 raft_consensus.cc:348] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.629607  4717 raft_consensus.cc:374] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.629657  4717 raft_consensus.cc:729] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cb55a7d02db4c618d0a141fddf4bff6, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.629709  4717 consensus_queue.cc:260] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.629801  4717 ts_tablet_manager.cc:1428] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:02.629815  4737 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.629890  4737 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.631021  4718 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: Bootstrap starting.
I20260928 13:03:02.631227  4719 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: No bootstrap required, opened a new log
I20260928 13:03:02.631301  4719 ts_tablet_manager.cc:1397] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.001s
I20260928 13:03:02.631456  4719 raft_consensus.cc:348] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.631533  4719 raft_consensus.cc:374] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.631533  4718 tablet_bootstrap.cc:654] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:02.631565  4719 raft_consensus.cc:729] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436b2cf2dcbf4f3b8197fe386aa44534, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.631614  4719 consensus_queue.cc:260] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.631709  4719 ts_tablet_manager.cc:1428] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:02.631884  4724 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.631991  4724 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.632313  4718 tablet_bootstrap.cc:492] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: No bootstrap required, opened a new log
I20260928 13:03:02.632366  4718 ts_tablet_manager.cc:1397] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: Time spent bootstrapping tablet: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:02.632505  4718 raft_consensus.cc:348] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.632588  4718 raft_consensus.cc:374] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:02.632613  4718 raft_consensus.cc:729] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f4270f64cd44008972847e927b25fc, State: Initialized, Role: FOLLOWER
I20260928 13:03:02.632664  4718 consensus_queue.cc:260] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.632764  4718 ts_tablet_manager.cc:1428] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:02.632829  4723 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.632951  4723 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: This TxnStatusTablet replica's current role is: FOLLOWER
W20260928 13:03:02.638033  4695 tablet.cc:2369] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:02.757376  4724 raft_consensus.cc:482] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:02.757485  4724 raft_consensus.cc:504] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.757946  4724 leader_election.cc:288] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2:41257), d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483)
I20260928 13:03:02.761216  4714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.758194 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50655 (local address 127.3.6.2:41257)
0928 13:03:02.758244 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.758246 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.758397 (+   151us) server_negotiation.cc:407] Connection header received
0928 13:03:02.758469 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.758470 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.758480 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.758554 (+    74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.758739 (+   185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.759276 (+   537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760430 (+  1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.760802 (+   372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760899 (+    97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.760910 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.761089 (+   179us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.761136 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:02.761233  4713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.758295 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:48937 (local address 127.3.6.3:39483)
0928 13:03:02.758344 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.758345 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.758415 (+    70us) server_negotiation.cc:407] Connection header received
0928 13:03:02.758487 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.758488 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.758497 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.758551 (+    54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:02.758742 (+   191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.759294 (+   552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760452 (+  1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.760809 (+   357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760899 (+    90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.760910 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.761122 (+   212us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.761164 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 13:03:02.761262  4756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.758142 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41257 (local address 127.3.6.1:50655)
0928 13:03:02.758306 (+   164us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.758318 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.758410 (+    92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.758558 (+   148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.758559 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.758561 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.758662 (+   101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.758664 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.759367 (+   703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.759368 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.760340 (+   972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.760342 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.760923 (+   581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760925 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.760998 (+    73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.761002 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.761081 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.761134 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"mutex_wait_us":69,"thread_start_us":66,"threads_started":1}
I20260928 13:03:02.761276  4757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.758232 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:39483 (local address 127.3.6.1:48937)
0928 13:03:02.758357 (+   125us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.758367 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.758432 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.758559 (+   127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.758559 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.758565 (+     6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:02.758659 (+    94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.758661 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.759389 (+   728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.759390 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.760336 (+   946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.760339 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.760923 (+   584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.760924 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.760997 (+    73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.761001 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.761095 (+    94us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.761140 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":45,"thread_start_us":62,"threads_started":1}
I20260928 13:03:02.761806  4508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1029392e5aea4a52a6c11885850753f3" candidate_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" is_pre_election: true
I20260928 13:03:02.761963  4508 raft_consensus.cc:2454] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 436b2cf2dcbf4f3b8197fe386aa44534 in term 0.
I20260928 13:03:02.761934  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1029392e5aea4a52a6c11885850753f3" candidate_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc" is_pre_election: true
I20260928 13:03:02.762006  4648 raft_consensus.cc:2454] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 436b2cf2dcbf4f3b8197fe386aa44534 in term 0.
I20260928 13:03:02.762172  4301 leader_election.cc:302] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436b2cf2dcbf4f3b8197fe386aa44534, 8cb55a7d02db4c618d0a141fddf4bff6; no voters: 
I20260928 13:03:02.762324  4724 raft_consensus.cc:2781] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:02.762367  4724 raft_consensus.cc:482] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:02.762394  4724 raft_consensus.cc:3037] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.763178  4724 raft_consensus.cc:504] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.763329  4724 leader_election.cc:288] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [CANDIDATE]: Term 1 election: Requested vote from peers 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2:41257), d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483)
I20260928 13:03:02.763478  4508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1029392e5aea4a52a6c11885850753f3" candidate_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8cb55a7d02db4c618d0a141fddf4bff6"
I20260928 13:03:02.763557  4508 raft_consensus.cc:3037] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.763582  4648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1029392e5aea4a52a6c11885850753f3" candidate_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5f4270f64cd44008972847e927b25fc"
I20260928 13:03:02.763710  4648 raft_consensus.cc:3037] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:02.764297  4508 raft_consensus.cc:2454] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436b2cf2dcbf4f3b8197fe386aa44534 in term 1.
I20260928 13:03:02.764302  4648 raft_consensus.cc:2454] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 436b2cf2dcbf4f3b8197fe386aa44534 in term 1.
I20260928 13:03:02.764487  4301 leader_election.cc:302] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436b2cf2dcbf4f3b8197fe386aa44534, 8cb55a7d02db4c618d0a141fddf4bff6; no voters: 
I20260928 13:03:02.764595  4724 raft_consensus.cc:2781] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:02.764704  4724 raft_consensus.cc:686] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 LEADER]: Becoming Leader. State: Replica: 436b2cf2dcbf4f3b8197fe386aa44534, State: Running, Role: LEADER
I20260928 13:03:02.764756  4724 consensus_queue.cc:237] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } }
I20260928 13:03:02.765138  4758 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: TxnStatusTablet state changed. Reason: New leader 436b2cf2dcbf4f3b8197fe386aa44534. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.765236  4758 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:02.765419  4760 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 13:03:02.765578  4760 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 13:03:02.765601  4209 catalog_manager.cc:5495] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 reported cstate change: term changed from 0 to 1, leader changed from <none> to 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } health_report { overall_health: UNKNOWN } } }
I20260928 13:03:02.777510  4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.774965 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39606 (local address 127.3.6.1:36327)
0928 13:03:02.775075 (+   110us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.775077 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.775083 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:02.775111 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.775112 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.775127 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.775204 (+    77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:02.775369 (+   165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.775860 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.776645 (+   785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.776839 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.776928 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.777135 (+   207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.777261 (+   126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.777341 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.777408 (+    67us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.777429 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260928 13:03:02.777520  4752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.774726 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36327 (local address 127.0.0.1:39606)
0928 13:03:02.774818 (+    92us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.774830 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.774873 (+    43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.775223 (+   350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.775224 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.775226 (+     2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:02.775293 (+    67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.775295 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.775949 (+   654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.775950 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.776522 (+   572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.776524 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.776925 (+   401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.776928 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.777011 (+    83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.777025 (+    14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.777338 (+   313us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.777348 (+    10us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.777402 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.777452 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260928 13:03:02.778851  4648 raft_consensus.cc:1261] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Refusing update from remote peer 436b2cf2dcbf4f3b8197fe386aa44534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.778980  4508 raft_consensus.cc:1261] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Refusing update from remote peer 436b2cf2dcbf4f3b8197fe386aa44534: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.779127  4758 consensus_queue.cc:1035] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.779239  4724 consensus_queue.cc:1035] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.779845  4737 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: TxnStatusTablet state changed. Reason: New leader 436b2cf2dcbf4f3b8197fe386aa44534. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.779937  4737 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.779884  4723 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: TxnStatusTablet state changed. Reason: New leader 436b2cf2dcbf4f3b8197fe386aa44534. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.779980  4723 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.780689  4758 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.780773  4758 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:02.780915  4724 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.781002  4724 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 436b2cf2dcbf4f3b8197fe386aa44534: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:02.781126  4730 mvcc.cc:205] Tried to move back new op lower bound from 7334299987060060160 to 7334299987005001728. Current Snapshot: MvccSnapshot[applied={T|T < 7334299987060060160 or (T in {7334299987060060160})}]
I20260928 13:03:02.781273  4723 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.781286  4737 tablet_replica.cc:439] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 } } peers { permanent_uuid: "8cb55a7d02db4c618d0a141fddf4bff6" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41257 } } peers { permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 } } }
I20260928 13:03:02.781349  4723 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P d5f4270f64cd44008972847e927b25fc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.781352  4737 tablet_replica.cc:442] T 1029392e5aea4a52a6c11885850753f3 P 8cb55a7d02db4c618d0a141fddf4bff6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:02.787703  4767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.785051 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36327 (local address 127.3.6.2:43835)
0928 13:03:02.785154 (+   103us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.785165 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.785227 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.785346 (+   119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.785347 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.785348 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:02.785390 (+    42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.785391 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.786240 (+   849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.786240 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.786822 (+   582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.786824 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.787312 (+   488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.787315 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.787360 (+    45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.787373 (+    13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.787563 (+   190us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.787564 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.787605 (+    41us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.787648 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"thread_start_us":53,"threads_started":1}
I20260928 13:03:02.787698  4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.785126 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:43835 (local address 127.3.6.1:36327)
0928 13:03:02.785173 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.785175 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.785210 (+    35us) server_negotiation.cc:407] Connection header received
0928 13:03:02.785269 (+    59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.785270 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.785280 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.785345 (+    65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:02.785428 (+    83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.786151 (+   723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.786911 (+   760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.787231 (+   320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.787296 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.787452 (+   156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.787485 (+    33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.787554 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.787608 (+    54us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.787626 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:02.790015  4648 raft_consensus.cc:1261] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Refusing update from remote peer 8cb55a7d02db4c618d0a141fddf4bff6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.790045  4368 raft_consensus.cc:1261] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Refusing update from remote peer 8cb55a7d02db4c618d0a141fddf4bff6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:02.790283  4727 consensus_queue.cc:1035] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5f4270f64cd44008972847e927b25fc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.790408  4737 consensus_queue.cc:1035] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436b2cf2dcbf4f3b8197fe386aa44534" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:02.799772  4771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.796516 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41257 (local address 127.3.6.1:43675)
0928 13:03:02.796775 (+   259us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:02.796787 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:02.796855 (+    68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:02.796982 (+   127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:02.796982 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:02.796983 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:02.797050 (+    67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.797051 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.797935 (+   884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.797936 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.798874 (+   938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:02.798876 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.799356 (+   480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.799359 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:02.799417 (+    58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.799430 (+    13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.799634 (+   204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.799635 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:02.799668 (+    33us) client_negotiation.cc:240] Negotiation successful
0928 13:03:02.799703 (+    35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":84,"threads_started":1}
I20260928 13:03:02.799767  4714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.796553 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43675 (local address 127.3.6.2:41257)
0928 13:03:02.796590 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.796592 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.796843 (+   251us) server_negotiation.cc:407] Connection header received
0928 13:03:02.796899 (+    56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.796899 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.796912 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.796981 (+    69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:02.797109 (+   128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.797836 (+   727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.798947 (+  1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.799274 (+   327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.799345 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.799525 (+   180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:02.799557 (+    32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:02.799613 (+    56us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.799671 (+    58us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.799693 (+    22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:03:02.807973  4209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:02.808099  4209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38850:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:02.808779  4209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8aa47ee82a6d415cbaf22b64ed85868c: Sending DeleteTablet for 3 replicas of tablet d426b464e1bc4009bab435a8ae11ff61
I20260928 13:03:02.809072  4488 tablet_service.cc:1514] Processing DeleteTablet for tablet d426b464e1bc4009bab435a8ae11ff61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:45392
I20260928 13:03:02.809021  4348 tablet_service.cc:1514] Processing DeleteTablet for tablet d426b464e1bc4009bab435a8ae11ff61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39592
I20260928 13:03:02.809120  4628 tablet_service.cc:1514] Processing DeleteTablet for tablet d426b464e1bc4009bab435a8ae11ff61 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:02 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:38708
I20260928 13:03:02.809185  4742 tablet_replica.cc:330] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: stopping tablet replica
I20260928 13:03:02.809212  4740 tablet_replica.cc:330] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: stopping tablet replica
I20260928 13:03:02.809252  4740 raft_consensus.cc:2229] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:02.809252  4742 raft_consensus.cc:2229] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:02.809294  4740 raft_consensus.cc:2258] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.809337  4742 raft_consensus.cc:2258] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.809494  4741 tablet_replica.cc:330] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: stopping tablet replica
I20260928 13:03:02.809569  4741 raft_consensus.cc:2229] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:02.809614  4741 raft_consensus.cc:2258] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:02.809806  4740 ts_tablet_manager.cc:1905] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.810071  4741 ts_tablet_manager.cc:1905] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.811518  4742 ts_tablet_manager.cc:1905] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:02.811518  4740 ts_tablet_manager.cc:1918] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:02.811578  4740 log.cc:1196] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/d426b464e1bc4009bab435a8ae11ff61
I20260928 13:03:02.811636  4741 ts_tablet_manager.cc:1918] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:02.811686  4741 log.cc:1196] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/d426b464e1bc4009bab435a8ae11ff61
I20260928 13:03:02.811807  4740 ts_tablet_manager.cc:1939] T d426b464e1bc4009bab435a8ae11ff61 P d5f4270f64cd44008972847e927b25fc: Deleting consensus metadata
I20260928 13:03:02.811899  4741 ts_tablet_manager.cc:1939] T d426b464e1bc4009bab435a8ae11ff61 P 436b2cf2dcbf4f3b8197fe386aa44534: Deleting consensus metadata
I20260928 13:03:02.812103  4196 catalog_manager.cc:4841] TS d5f4270f64cd44008972847e927b25fc (127.3.6.3:39483): tablet d426b464e1bc4009bab435a8ae11ff61 (table test-table [id=5ff338cd775f4b979497e5f5e642292e]) successfully deleted
I20260928 13:03:02.812826  4742 ts_tablet_manager.cc:1918] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:02.812865  4742 log.cc:1196] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/d426b464e1bc4009bab435a8ae11ff61
I20260928 13:03:02.813014  4742 ts_tablet_manager.cc:1939] T d426b464e1bc4009bab435a8ae11ff61 P 8cb55a7d02db4c618d0a141fddf4bff6: Deleting consensus metadata
I20260928 13:03:02.813205  4196 catalog_manager.cc:4841] TS 436b2cf2dcbf4f3b8197fe386aa44534 (127.3.6.1:36327): tablet d426b464e1bc4009bab435a8ae11ff61 (table test-table [id=5ff338cd775f4b979497e5f5e642292e]) successfully deleted
I20260928 13:03:02.813558  4197 catalog_manager.cc:4841] TS 8cb55a7d02db4c618d0a141fddf4bff6 (127.3.6.2:41257): tablet d426b464e1bc4009bab435a8ae11ff61 (table test-table [id=5ff338cd775f4b979497e5f5e642292e]) successfully deleted
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4166](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600582, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:02.821839  4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.810113 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39620 (local address 127.3.6.1:36327)
0928 13:03:02.810151 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.810153 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.813550 (+  3397us) server_negotiation.cc:407] Connection header received
0928 13:03:02.813620 (+    70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.813621 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.813633 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.813682 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.814273 (+   591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.814755 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.815578 (+   823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.815789 (+   211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.815871 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.818730 (+  2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.818737 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.818738 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.818746 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.820677 (+  1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.821016 (+   339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.821019 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.821020 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.821086 (+    66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.821274 (+   188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.821274 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.821275 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.821450 (+   175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.821607 (+   157us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.821645 (+    38us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.821728 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 13:03:02.822129  4408 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39620
I20260928 13:03:02.829906  4260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:02.823176 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38860 (local address 127.3.6.62:43513)
0928 13:03:02.823226 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:02.823228 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:02.823273 (+    45us) server_negotiation.cc:407] Connection header received
0928 13:03:02.823344 (+    71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:02.823344 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:02.823353 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:02.823394 (+    41us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:02.824008 (+   614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.824495 (+   487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.825514 (+  1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:02.825693 (+   179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:02.825745 (+    52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:02.827131 (+  1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:02.827133 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:02.827133 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:02.827139 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:02.828670 (+  1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.829109 (+   439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.829111 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.829111 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.829182 (+    71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:02.829385 (+   203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:02.829386 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:02.829386 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:02.829500 (+   114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:02.829616 (+   116us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:02.829720 (+   104us) server_negotiation.cc:299] Negotiation successful
0928 13:03:02.829800 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260928 13:03:02.830149  4209 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38860
I20260928 13:03:02.830755  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4283
I20260928 13:03:02.835981  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4423
I20260928 13:03:02.841962  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4563
I20260928 13:03:02.847142  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4179
2026-09-28T13:03:02Z chronyd exiting
[       OK ] SecurityITest.SmokeTestAsAuthorizedUser (2277 ms)
[ RUN      ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4779](info): set up 2 sockets
Sep 28 13:03:02 dist-test-slave-ddvw krb5kdc[4779](info): commencing operation
krb5kdc: starting...
W20260928 13:03:03.883162  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.015s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:03 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:04.006655  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43475
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:43475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:04.088089  4792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:04.088307  4792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:04.088330  4792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:04.089394  4792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:04.089426  4792 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 13:03:04.089439  4792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:04.089452  4792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:04.089465  4792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:04.089478  4792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:04.090927  4792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:43475
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:04.091171  4792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:04.091359  4792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:04.096328  4798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.096300  4797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.096302  4800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:04.096489  4792 server_base.cc:1034] running on GCE node
I20260928 13:03:04.097187  4792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:04.097510  4792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:04.098680  4792 hybrid_clock.cc:648] HybridClock initialized: now 1790600584098668 us; error 44 us; skew 500 ppm
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:04.101162  4792 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:04.101648  4792 webserver.cc:460] Webserver started at http://127.3.6.62:39299/ using document root <none> and password file <none>
I20260928 13:03:04.101881  4792 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:04.101949  4792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:04.102102  4792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:04.103229  4792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "40cd8195c5624746aa75ab325c98370e"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "6c435ad3032b673ee9f407b4e48f0bc7"
server_key_iv: "d80961cc95e292db87ed3fba018a5fd3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.103587  4792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "40cd8195c5624746aa75ab325c98370e"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "6c435ad3032b673ee9f407b4e48f0bc7"
server_key_iv: "d80961cc95e292db87ed3fba018a5fd3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.104910  4792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:04.105620  4807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.105796  4792 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:04.105895  4792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "40cd8195c5624746aa75ab325c98370e"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "6c435ad3032b673ee9f407b4e48f0bc7"
server_key_iv: "d80961cc95e292db87ed3fba018a5fd3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.105980  4792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:04.116784  4792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:04.118592  4792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:04.118767  4792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:04.123544  4792 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:43475
I20260928 13:03:04.123588  4869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:43475 every 8 connection(s)
I20260928 13:03:04.123970  4792 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:04.124598  4870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.127354  4870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Bootstrap starting.
I20260928 13:03:04.128010  4870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.128345  4870 log.cc:824] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:04.129091  4870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: No bootstrap required, opened a new log
I20260928 13:03:04.131273  4870 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } }
I20260928 13:03:04.131443  4870 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.131485  4870 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40cd8195c5624746aa75ab325c98370e, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.131534  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4792
I20260928 13:03:04.131609  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:04.131706  4870 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } }
I20260928 13:03:04.131808  4870 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:04.131810  3096 external_mini_cluster.cc:1428] Setting key 466970f929014d14c3de2d9ecea521ed
I20260928 13:03:04.131855  4870 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:04.131912  4870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:04.132654  4870 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } }
I20260928 13:03:04.132776  4870 leader_election.cc:302] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40cd8195c5624746aa75ab325c98370e; no voters: 
I20260928 13:03:04.132947  4870 leader_election.cc:288] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:04.132997  4875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:04.133128  4875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [term 1 LEADER]: Becoming Leader. State: Replica: 40cd8195c5624746aa75ab325c98370e, State: Running, Role: LEADER
I20260928 13:03:04.133212  4875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } }
I20260928 13:03:04.133229  4870 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:04.133536  4875 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40cd8195c5624746aa75ab325c98370e. Latest consensus state: current_term: 1 leader_uuid: "40cd8195c5624746aa75ab325c98370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } } }
I20260928 13:03:04.133625  4875 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:04.133558  4876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40cd8195c5624746aa75ab325c98370e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40cd8195c5624746aa75ab325c98370e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43475 } } }
I20260928 13:03:04.133847  4879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:04.133875  4876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:04.134344  4879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:04.135957  4879 catalog_manager.cc:1347] Generated new cluster ID: b3a3218bf78e49f8b99144a72db8dc10
I20260928 13:03:04.136009  4879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600583, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.141876  4879 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:04.142478  4879 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:04.143877  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.132316 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.3.6.62:43475)
0928 13:03:04.132505 (+   189us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.132513 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.132546 (+    33us) server_negotiation.cc:407] Connection header received
0928 13:03:04.132645 (+    99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.132650 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.132693 (+    43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.132846 (+   153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.133696 (+   850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.135353 (+  1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.136261 (+   908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.136869 (+   608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.136984 (+   115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.139866 (+  2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.139870 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.139871 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.139883 (+    12us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.142074 (+  2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.142491 (+   417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.142494 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.142494 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.142607 (+   113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.142843 (+   236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.142844 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.142844 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.143128 (+   284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.143292 (+   164us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.143404 (+   112us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.143664 (+   260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":107,"threads_started":1}
I20260928 13:03:04.147307  4879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Generated new TSK 0
I20260928 13:03:04.147488  4879 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:04.178557  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43475
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:04.260622  4896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:04.260826  4896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:04.260851  4896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:04.262022  4896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:04.262066  4896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:04.262086  4896 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 13:03:04.262099  4896 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:04.262115  4896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:04.263793  4896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:04.264053  4896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:04.264336  4896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:04.269806  4901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.269917  4902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.269806  4904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:04.270081  4896 server_base.cc:1034] running on GCE node
I20260928 13:03:04.270268  4896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:04.270522  4896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:04.271715  4896 hybrid_clock.cc:648] HybridClock initialized: now 1790600584271708 us; error 34 us; skew 500 ppm
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:04.274292  4896 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:04.274775  4896 webserver.cc:460] Webserver started at http://127.3.6.1:42441/ using document root <none> and password file <none>
I20260928 13:03:04.275076  4896 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:04.275147  4896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:04.275302  4896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:04.276368  4896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "585ffb65b61b475bba1942a59c7b8a8a"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "cdfa2c37ed77a3ada70621dee3da8217"
server_key_iv: "4313de7ba91d3dea90f8fc744cd3e8d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.276750  4896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "585ffb65b61b475bba1942a59c7b8a8a"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "cdfa2c37ed77a3ada70621dee3da8217"
server_key_iv: "4313de7ba91d3dea90f8fc744cd3e8d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.278085  4896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:04.278908  4911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.279121  4896 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:04.279234  4896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "585ffb65b61b475bba1942a59c7b8a8a"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "cdfa2c37ed77a3ada70621dee3da8217"
server_key_iv: "4313de7ba91d3dea90f8fc744cd3e8d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.279312  4896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:04.291978  4896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:04.294171  4896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:04.294348  4896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:04.294859  4896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:04.294930  4896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.294974  4896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:04.294997  4896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.302099  4896 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37455
I20260928 13:03:04.302157  5026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37455 every 8 connection(s)
I20260928 13:03:04.302537  4896 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.303503  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 4896
I20260928 13:03:04.303637  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:04.303824  3096 external_mini_cluster.cc:1428] Setting key e7d0061dc75d89878d2c0bf4c9f0a83d
I20260928 13:03:04.306263  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.295350 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:40075 (local address 127.3.6.62:43475)
0928 13:03:04.295425 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.295428 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.295695 (+   267us) server_negotiation.cc:407] Connection header received
0928 13:03:04.296156 (+   461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.296158 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.296182 (+    24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.296259 (+    77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.297193 (+   934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.298031 (+   838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.299153 (+  1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.299525 (+   372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.299610 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.303222 (+  3612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.303224 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.303224 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.303231 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.304826 (+  1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.305268 (+   442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.305269 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.305269 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.305325 (+    56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.305594 (+   269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.305595 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.305595 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.305717 (+   122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.305789 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.306074 (+   285us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.306164 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:03:04.306458  4920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.295337 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.1:40075)
0928 13:03:04.295503 (+   166us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.295593 (+    90us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.296060 (+   467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.296387 (+   327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.296391 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.296794 (+   403us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.297073 (+   279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.297080 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.298139 (+  1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.298139 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.298991 (+   852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.298993 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.299625 (+   632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.299640 (+    15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.299809 (+   169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.301069 (+  1260us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.301086 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.303123 (+  2037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.304937 (+  1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.304944 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.304946 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.305173 (+   227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.305402 (+   229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.305402 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.305403 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.305517 (+   114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.305795 (+   278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.305801 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.305942 (+   141us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.306053 (+   111us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.306218 (+   165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260928 13:03:04.306939  5027 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43475
I20260928 13:03:04.307065  5027 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:04.307263  5027 heartbeater.cc:511] Master 127.3.6.62:43475 requested a full tablet report, sending...
I20260928 13:03:04.307801  4824 ts_manager.cc:194] Registered new tserver with Master: 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455)
I20260928 13:03:04.308765  4824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:40075
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:03:04.315574  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.309206 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:42661 (local address 127.3.6.62:43475)
0928 13:03:04.309249 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.309252 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.309557 (+   305us) server_negotiation.cc:407] Connection header received
0928 13:03:04.309584 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.309585 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.309597 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.309652 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.310114 (+   462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.310571 (+   457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.311662 (+  1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.311839 (+   177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.311893 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.312971 (+  1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.312972 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.312972 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.312978 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.314398 (+  1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.314751 (+   353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.314753 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.314753 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.314812 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.315118 (+   306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.315119 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.315119 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.315226 (+   107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.315278 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.315424 (+   146us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.315506 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
I20260928 13:03:04.315603  5034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.309297 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.1:42661)
0928 13:03:04.309433 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.309445 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.309509 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.309705 (+   196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.309706 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.309955 (+   249us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.310027 (+    72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.310029 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.310675 (+   646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.310676 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.311579 (+   903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.311583 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.311915 (+   332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.311919 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.312010 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.312425 (+   415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.312431 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.312822 (+   391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.314485 (+  1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.314487 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.314487 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.314665 (+   178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.314915 (+   250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.314916 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.314916 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.314978 (+    62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.315286 (+   308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.315287 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.315323 (+    36us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.315385 (+    62us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.315464 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:04.330349  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43475
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:04.413158  5036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:04.413374  5036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:04.413400  5036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:04.414580  5036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:04.414625  5036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:04.414647  5036 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 13:03:04.414702  5036 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:04.414731  5036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:04.416224  5036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:04.416486  5036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:04.416740  5036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:04.421929  5044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.421926  5042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:04.421928  5036 server_base.cc:1034] running on GCE node
W20260928 13:03:04.422004  5041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:04.422300  5036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:04.422502  5036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:04.423637  5036 hybrid_clock.cc:648] HybridClock initialized: now 1790600584423602 us; error 49 us; skew 500 ppm
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:04.426098  5036 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:04.426476  5036 webserver.cc:460] Webserver started at http://127.3.6.2:41239/ using document root <none> and password file <none>
I20260928 13:03:04.426651  5036 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:04.426697  5036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:04.426784  5036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:04.427871  5036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "73c0fa6f00724bf4a1ae1932211932a7"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "0b6ea9dfb1af5b39174fd6794b330c6a"
server_key_iv: "c8cd739e70760c47b61ef0cbdfefb505"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.428165  5036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "73c0fa6f00724bf4a1ae1932211932a7"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "0b6ea9dfb1af5b39174fd6794b330c6a"
server_key_iv: "c8cd739e70760c47b61ef0cbdfefb505"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.429430  5036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:04.430156  5051 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.430338  5036 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:04.430445  5036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "73c0fa6f00724bf4a1ae1932211932a7"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "0b6ea9dfb1af5b39174fd6794b330c6a"
server_key_iv: "c8cd739e70760c47b61ef0cbdfefb505"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.430522  5036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:04.453070  5036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:04.455124  5036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:04.455329  5036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:04.455932  5036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:04.456004  5036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.456051  5036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:04.456079  5036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.463505  5036 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:36037
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.463954  5036 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:04.465617  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5036
I20260928 13:03:04.465708  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:04.465926  3096 external_mini_cluster.cc:1428] Setting key 214483f59b8571133d65fc5361192640
I20260928 13:03:04.468693  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.456523 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:49005 (local address 127.3.6.62:43475)
0928 13:03:04.456606 (+    83us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.456609 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.456866 (+   257us) server_negotiation.cc:407] Connection header received
0928 13:03:04.457387 (+   521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.457388 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.457403 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.457483 (+    80us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.458502 (+  1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.459387 (+   885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.460666 (+  1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.461014 (+   348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.461115 (+   101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.464484 (+  3369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.464486 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.464487 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.464495 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.466328 (+  1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.466893 (+   565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.466895 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.466895 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.466978 (+    83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.467755 (+   777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.467756 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.467756 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.467943 (+   187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.468017 (+    74us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.468504 (+   487us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.468607 (+   103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 13:03:04.469241  5060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.456488 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.2:49005)
0928 13:03:04.456721 (+   233us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.456763 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.457282 (+   519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.457566 (+   284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.457570 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.458018 (+   448us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.458345 (+   327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.458352 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.459520 (+  1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.459521 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.460545 (+  1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.460548 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.461113 (+   565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.461124 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.461270 (+   146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.462231 (+   961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.462240 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.464360 (+  2120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.466440 (+  2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.466448 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.466451 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.466802 (+   351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.467237 (+   435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.467238 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.467238 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.467414 (+   176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.468048 (+   634us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.468052 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.468290 (+   238us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.468433 (+   143us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.469071 (+   638us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":161,"threads_started":1}
I20260928 13:03:04.467878  5166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:36037 every 8 connection(s)
I20260928 13:03:04.470763  5167 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43475
I20260928 13:03:04.470862  5167 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:04.471148  5167 heartbeater.cc:511] Master 127.3.6.62:43475 requested a full tablet report, sending...
I20260928 13:03:04.472090  4823 ts_manager.cc:194] Registered new tserver with Master: 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037)
I20260928 13:03:04.472602  4823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:49005
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:03:04.478744  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.471960 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:53747 (local address 127.3.6.62:43475)
0928 13:03:04.471997 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.471999 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.472717 (+   718us) server_negotiation.cc:407] Connection header received
0928 13:03:04.472739 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.472739 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.472751 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.472809 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.473294 (+   485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.474038 (+   744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.475176 (+  1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.475354 (+   178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.475412 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.476449 (+  1037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.476450 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.476451 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.476456 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.477693 (+  1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.478046 (+   353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.478047 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.478048 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.478125 (+    77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.478320 (+   195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.478320 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.478321 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.478447 (+   126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.478498 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.478610 (+   112us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.478672 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:04.478796  5174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.471815 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.2:53747)
0928 13:03:04.472407 (+   592us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.472420 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.472497 (+    77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.472822 (+   325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.472823 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.473049 (+   226us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.473186 (+   137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.473189 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.474171 (+   982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.474172 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.475079 (+   907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.475083 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.475435 (+   352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.475439 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.475528 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.475959 (+   431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.475965 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.476370 (+   405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.477773 (+  1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.477774 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.477774 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.477930 (+   156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.478200 (+   270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.478201 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.478201 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.478261 (+    60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.478489 (+   228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.478490 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.478521 (+    31us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.478567 (+    46us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.478642 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:04.494156  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43475
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:04.574092  5176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:04.574369  5176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:04.574412  5176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:04.575628  5176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:04.575711  5176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:04.575744  5176 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 13:03:04.575776  5176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:04.575814  5176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:04.577265  5176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:43475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:04.577540  5176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:04.577790  5176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:04.582942  5176 server_base.cc:1034] running on GCE node
W20260928 13:03:04.582903  5181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.582912  5182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:04.582912  5184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:04.583390  5176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:04.583670  5176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:04.584867  5176 hybrid_clock.cc:648] HybridClock initialized: now 1790600584584853 us; error 34 us; skew 500 ppm
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:04.587538  5176 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:04.588058  5176 webserver.cc:460] Webserver started at http://127.3.6.3:34603/ using document root <none> and password file <none>
I20260928 13:03:04.588294  5176 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:04.588368  5176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:04.588522  5176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:04.589566  5176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "518c470ce786409e954a3b9536d71d26"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "e3c7d6d753ed0126bfba74634c708850"
server_key_iv: "1c516eb9a637a8dadf8c01b713e2f4f2"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.589952  5176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "518c470ce786409e954a3b9536d71d26"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "e3c7d6d753ed0126bfba74634c708850"
server_key_iv: "1c516eb9a637a8dadf8c01b713e2f4f2"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.591367  5176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:04.592157  5191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.592363  5176 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:04.592471  5176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "518c470ce786409e954a3b9536d71d26"
format_stamp: "Formatted at 2026-09-28 13:03:04 on dist-test-slave-ddvw"
server_key: "e3c7d6d753ed0126bfba74634c708850"
server_key_iv: "1c516eb9a637a8dadf8c01b713e2f4f2"
server_key_version: "encryptionkey@0"
I20260928 13:03:04.592546  5176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:04.610682  5176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:04.613126  5176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:04.613302  5176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:04.613914  5176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:04.613963  5176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:04.613996  5176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:04.614022  5176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.621721  5176 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:41805
I20260928 13:03:04.622083  5176 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:04.622093  5306 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:41805 every 8 connection(s)
I20260928 13:03:04.624569  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.614391 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:52969 (local address 127.3.6.62:43475)
0928 13:03:04.614470 (+    79us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.614472 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.614718 (+   246us) server_negotiation.cc:407] Connection header received
0928 13:03:04.615313 (+   595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.615315 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.615329 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.615410 (+    81us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.616153 (+   743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.616982 (+   829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.618172 (+  1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.618535 (+   363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.618610 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.621416 (+  2806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.621417 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.621417 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.621446 (+    29us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.623261 (+  1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.623639 (+   378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.623639 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.623640 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.623696 (+    56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.623975 (+   279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.623975 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.623976 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.624080 (+   104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.624132 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.624442 (+   310us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.624504 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:04.624876  5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.614367 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.3:52969)
0928 13:03:04.614537 (+   170us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.614613 (+    76us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.615210 (+   597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.615495 (+   285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.615499 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.615748 (+   249us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.616076 (+   328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.616082 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.617103 (+  1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.617104 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.618064 (+   960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.618075 (+    11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.618618 (+   543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.618629 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.618815 (+   186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.619407 (+   592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.619420 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.621317 (+  1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.623334 (+  2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.623338 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.623340 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.623563 (+   223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.623781 (+   218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.623782 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.623782 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.623895 (+   113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.624183 (+   288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.624188 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.624310 (+   122us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.624412 (+   102us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.624611 (+   199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":88,"threads_started":1}
I20260928 13:03:04.625392  5307 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43475
I20260928 13:03:04.625476  5307 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:04.625686  5307 heartbeater.cc:511] Master 127.3.6.62:43475 requested a full tablet report, sending...
I20260928 13:03:04.626024  4824 ts_manager.cc:194] Registered new tserver with Master: 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:04.626452  4824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:52969
I20260928 13:03:04.629106  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5176
I20260928 13:03:04.629227  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:04.629424  3096 external_mini_cluster.cc:1428] Setting key c9edfcfd79c72b0c95905e49665aa27a
I20260928 13:03:04.630313  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:04.632393  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.626554 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:48385 (local address 127.3.6.62:43475)
0928 13:03:04.626673 (+   119us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.626675 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.626791 (+   116us) server_negotiation.cc:407] Connection header received
0928 13:03:04.626853 (+    62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.626853 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.626861 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.626904 (+    43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.627265 (+   361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.627731 (+   466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.628458 (+   727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.628633 (+   175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.628703 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.629820 (+  1117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.629822 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.629822 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.629829 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.631264 (+  1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.631609 (+   345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.631610 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.631611 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.631666 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.631874 (+   208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.631875 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.631875 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.631982 (+   107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.632062 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.632221 (+   159us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.632297 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260928 13:03:04.632408  5313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.626482 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.3.6.3:48385)
0928 13:03:04.626712 (+   230us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.626724 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.626797 (+    73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.626908 (+   111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.626909 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.627130 (+   221us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.627193 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.627195 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.627856 (+   661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.627856 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.628373 (+   517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.628375 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.628708 (+   333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.628710 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.628762 (+    52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.629315 (+   553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.629320 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.629734 (+   414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.631348 (+  1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.631349 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.631349 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.631527 (+   178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.631736 (+   209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.631737 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.631738 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.631797 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.632053 (+   256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.632054 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.632105 (+    51us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.632196 (+    91us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.632301 (+   105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":161,"threads_started":1}
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.653985  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.646447 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52698 (local address 127.3.6.62:43475)
0928 13:03:04.646533 (+    86us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.646535 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.646546 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:04.646576 (+    30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.646577 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.646588 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.646652 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.647254 (+   602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.647980 (+   726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.648702 (+   722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.648883 (+   181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.648944 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.651313 (+  2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.651315 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.651315 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.651322 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.652965 (+  1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.653329 (+   364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.653330 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.653331 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.653384 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.653557 (+   173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.653558 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.653558 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.653668 (+   110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.653740 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.653853 (+   113us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.653915 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260928 13:03:04.656064  4824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:04.657771  4824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:04.664422  5326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660352 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41805 (local address 127.0.0.1:42096)
0928 13:03:04.660790 (+   438us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.660836 (+    46us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.660931 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.661267 (+   336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.661268 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.661269 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:04.661316 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.661320 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.662221 (+   901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.662222 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.663166 (+   944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.663168 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.664131 (+   963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.664132 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.664213 (+    81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.664224 (+    11us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.664290 (+    66us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.664339 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":4,"thread_start_us":58,"threads_started":1}
I20260928 13:03:04.664469  5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660429 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42096 (local address 127.3.6.3:41805)
0928 13:03:04.660579 (+   150us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.660584 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.660942 (+   358us) server_negotiation.cc:407] Connection header received
0928 13:03:04.661119 (+   177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.661121 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.661138 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.661207 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:04.661411 (+   204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.662145 (+   734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.663261 (+  1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.663946 (+   685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.663993 (+    47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.664071 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.664331 (+   260us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.664373 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":80,"threads_started":1}
I20260928 13:03:04.665132  5241 tablet_service.cc:1467] Processing CreateTablet for tablet e5048737be3d4e47b47625f72f2fde6a (DEFAULT_TABLE table=test-table [id=abb57b8075bb4c3a8116062efea80743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:04.665519  5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5048737be3d4e47b47625f72f2fde6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.665771  5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660364 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:36037 (local address 127.0.0.1:33426)
0928 13:03:04.661128 (+   764us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.661137 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.661182 (+    45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.662229 (+  1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.662230 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.662232 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:04.662267 (+    35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.662269 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.663586 (+  1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.663587 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.664658 (+  1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.664662 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.665556 (+   894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.665557 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.665615 (+    58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.665619 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.665666 (+    47us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.665703 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":748,"thread_start_us":86,"threads_started":1}
I20260928 13:03:04.666210  5324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660361 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.0.0.1:33034)
0928 13:03:04.660807 (+   446us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.660836 (+    29us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.660931 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.661231 (+   300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.661234 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.661236 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:04.661316 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.661318 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.663717 (+  2399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.663718 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.664909 (+  1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.664911 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.665976 (+  1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.665977 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.666050 (+    73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.666053 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.666111 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.666148 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":2,"thread_start_us":100,"threads_started":1}
I20260928 13:03:04.666204  5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660592 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.3.6.2:36037)
0928 13:03:04.660788 (+   196us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.660792 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.661242 (+   450us) server_negotiation.cc:407] Connection header received
0928 13:03:04.661286 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.661288 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.661305 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.661380 (+    75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:04.662360 (+   980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.663482 (+  1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.664744 (+  1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.665419 (+   675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.665476 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.665525 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.665930 (+   405us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.665971 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":85,"threads_started":1}
I20260928 13:03:04.666525  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.660661 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33034 (local address 127.3.6.1:37455)
0928 13:03:04.660833 (+   172us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.660837 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.660909 (+    72us) server_negotiation.cc:407] Connection header received
0928 13:03:04.661038 (+   129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.661040 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.661057 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.661147 (+    90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:04.662374 (+  1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.663634 (+  1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.665002 (+  1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.665833 (+   831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.665897 (+    64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.665947 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.666148 (+   201us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.666187 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":76,"threads_started":1}
I20260928 13:03:04.666848  5101 tablet_service.cc:1467] Processing CreateTablet for tablet e5048737be3d4e47b47625f72f2fde6a (DEFAULT_TABLE table=test-table [id=abb57b8075bb4c3a8116062efea80743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:04.667202  5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5048737be3d4e47b47625f72f2fde6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.668773  5330 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Bootstrap starting.
I20260928 13:03:04.669425  4961 tablet_service.cc:1467] Processing CreateTablet for tablet e5048737be3d4e47b47625f72f2fde6a (DEFAULT_TABLE table=test-table [id=abb57b8075bb4c3a8116062efea80743]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:04.669761  5330 tablet_bootstrap.cc:654] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.669777  4961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5048737be3d4e47b47625f72f2fde6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.670112  5330 log.cc:824] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:04.670264  5331 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Bootstrap starting.
I20260928 13:03:04.670828  5331 tablet_bootstrap.cc:654] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.671268  5331 log.cc:824] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:04.672070  5331 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: No bootstrap required, opened a new log
I20260928 13:03:04.672158  5331 ts_tablet_manager.cc:1397] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:04.673185  5334 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Bootstrap starting.
I20260928 13:03:04.673708  5330 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: No bootstrap required, opened a new log
I20260928 13:03:04.673780  5330 ts_tablet_manager.cc:1397] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260928 13:03:04.673840  5334 tablet_bootstrap.cc:654] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.674022  5331 raft_consensus.cc:348] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.674149  5331 raft_consensus.cc:374] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.674170  5331 raft_consensus.cc:729] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.674160  5334 log.cc:824] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:04.674300  5331 consensus_queue.cc:260] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.674574  5331 ts_tablet_manager.cc:1428] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:04.674624  5167 heartbeater.cc:503] Master 127.3.6.62:43475 was elected leader, sending a full tablet report...
I20260928 13:03:04.674856  5334 tablet_bootstrap.cc:492] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: No bootstrap required, opened a new log
I20260928 13:03:04.674926  5334 ts_tablet_manager.cc:1397] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:04.675953  5330 raft_consensus.cc:348] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.676122  5330 raft_consensus.cc:374] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.676160  5330 raft_consensus.cc:729] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.676262  5330 consensus_queue.cc:260] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.676445  5330 ts_tablet_manager.cc:1428] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:04.676532  5307 heartbeater.cc:503] Master 127.3.6.62:43475 was elected leader, sending a full tablet report...
I20260928 13:03:04.676846  5334 raft_consensus.cc:348] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.677021  5334 raft_consensus.cc:374] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.677081  5334 raft_consensus.cc:729] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.677191  5334 consensus_queue.cc:260] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.677450  5334 ts_tablet_manager.cc:1428] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:04.677510  5027 heartbeater.cc:503] Master 127.3.6.62:43475 was elected leader, sending a full tablet report...
W20260928 13:03:04.717957  5168 tablet.cc:2369] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:04.803403  5028 tablet.cc:2369] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:04.872808  5308 tablet.cc:2369] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:04.907248  5338 raft_consensus.cc:482] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:04.907377  5338 raft_consensus.cc:504] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.907757  5338 leader_election.cc:288] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805), 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037)
I20260928 13:03:04.910804  5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.908141 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:36785 (local address 127.3.6.3:41805)
0928 13:03:04.908211 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.908213 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.908275 (+    62us) server_negotiation.cc:407] Connection header received
0928 13:03:04.908361 (+    86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.908362 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.908373 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.908446 (+    73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:04.908636 (+   190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.909148 (+   512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910115 (+   967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.910460 (+   345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910541 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.910558 (+    17us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.910706 (+   148us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.910735 (+    29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:04.910809  5340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.908001 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41805 (local address 127.3.6.1:36785)
0928 13:03:04.908206 (+   205us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.908219 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.908292 (+    73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.908451 (+   159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.908452 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.908454 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:04.908525 (+    71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.908528 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.909239 (+   711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.909240 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.910016 (+   776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.910018 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.910551 (+   533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910552 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.910622 (+    70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.910626 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.910689 (+    63us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.910733 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":93,"threads_started":1}
I20260928 13:03:04.910874  5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.908111 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:46097 (local address 127.3.6.2:36037)
0928 13:03:04.908160 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.908163 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.908312 (+   149us) server_negotiation.cc:407] Connection header received
0928 13:03:04.908385 (+    73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.908386 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.908398 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.908481 (+    83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:04.908626 (+   145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.909238 (+   612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910172 (+   934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.910526 (+   354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910606 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.910615 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.910768 (+   153us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.910803 (+    35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:04.910934  5339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.908001 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:36037 (local address 127.3.6.1:46097)
0928 13:03:04.908216 (+   215us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.908227 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.908330 (+   103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.908473 (+   143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.908474 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.908476 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:04.908538 (+    62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.908540 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.909322 (+   782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.909323 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.910076 (+   753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.910077 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.910613 (+   536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.910614 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.910683 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.910688 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.910760 (+    72us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.910801 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":2,"spinlock_wait_cycles":14720,"thread_start_us":88,"threads_started":1}
I20260928 13:03:04.911346  5261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5048737be3d4e47b47625f72f2fde6a" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26" is_pre_election: true
I20260928 13:03:04.911506  5261 raft_consensus.cc:2454] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 0.
I20260928 13:03:04.911567  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5048737be3d4e47b47625f72f2fde6a" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7" is_pre_election: true
I20260928 13:03:04.911743  5121 raft_consensus.cc:2454] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 0.
I20260928 13:03:04.911782  4912 leader_election.cc:302] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 585ffb65b61b475bba1942a59c7b8a8a; no voters: 
I20260928 13:03:04.911897  5338 raft_consensus.cc:2781] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:04.911957  5338 raft_consensus.cc:482] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:04.911973  5338 raft_consensus.cc:3037] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:04.912726  5338 raft_consensus.cc:504] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.912864  5338 leader_election.cc:288] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 election: Requested vote from peers 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805), 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037)
I20260928 13:03:04.913019  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5048737be3d4e47b47625f72f2fde6a" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7"
I20260928 13:03:04.913013  5261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5048737be3d4e47b47625f72f2fde6a" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26"
I20260928 13:03:04.913092  5121 raft_consensus.cc:3037] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:04.913092  5261 raft_consensus.cc:3037] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:04.913946  5121 raft_consensus.cc:2454] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 1.
I20260928 13:03:04.913946  5261 raft_consensus.cc:2454] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 1.
I20260928 13:03:04.914113  4912 leader_election.cc:302] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 585ffb65b61b475bba1942a59c7b8a8a; no voters: 
I20260928 13:03:04.914207  5338 raft_consensus.cc:2781] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:04.914330  5338 raft_consensus.cc:686] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 LEADER]: Becoming Leader. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Running, Role: LEADER
I20260928 13:03:04.914422  5338 consensus_queue.cc:237] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } }
I20260928 13:03:04.915210  4824 catalog_manager.cc:5495] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1). New cstate: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } health_report { overall_health: UNKNOWN } } }
Sep 28 13:03:04 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600584, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:04.966701  5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.959856 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43475 (local address 127.0.0.1:52708)
0928 13:03:04.960112 (+   256us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:04.960123 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:04.960203 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:04.960338 (+   135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:04.960338 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:04.960646 (+   308us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:04.960695 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.960697 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.961380 (+   683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.961381 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.961939 (+   558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:04.961941 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.962291 (+   350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.962295 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:04.962334 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.962917 (+   583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:04.962921 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:04.964268 (+  1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:04.965762 (+  1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.965768 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.965770 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.965960 (+   190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.966135 (+   175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:04.966136 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:04.966136 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:04.966190 (+    54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:04.966400 (+   210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:04.966405 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:04.966443 (+    38us) client_negotiation.cc:769] Sending connection context
0928 13:03:04.966494 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:04.966626 (+   132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":141,"threads_started":1}
I20260928 13:03:04.966833  4874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:04.959912 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52708 (local address 127.3.6.62:43475)
0928 13:03:04.959995 (+    83us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:04.959998 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:04.960204 (+   206us) server_negotiation.cc:407] Connection header received
0928 13:03:04.960264 (+    60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:04.960265 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:04.960275 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:04.960320 (+    45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:04.960781 (+   461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.961301 (+   520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.962039 (+   738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:04.962222 (+   183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:04.962283 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:04.964349 (+  2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:04.964351 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:04.964351 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:04.964358 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:04.965689 (+  1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.966026 (+   337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.966027 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.966027 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.966079 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:04.966244 (+   165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:04.966245 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:04.966245 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:04.966348 (+   103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:04.966401 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:04.966527 (+   126us) server_negotiation.cc:299] Negotiation successful
0928 13:03:04.966690 (+   163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":97,"server-negotiator.queue_time_us":46}
I20260928 13:03:04.968828  4824 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:52708:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260928 13:03:04.969069  4824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:04.970680  5101 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ac2d94f8e4138959f8733d215943e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=75ddb3311d1e42be8c62d56e6ecb4fd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:04.970708  4961 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ac2d94f8e4138959f8733d215943e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=75ddb3311d1e42be8c62d56e6ecb4fd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:04.970700  5241 tablet_service.cc:1467] Processing CreateTablet for tablet 8d4ac2d94f8e4138959f8733d215943e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=75ddb3311d1e42be8c62d56e6ecb4fd8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:04.970868  4961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ac2d94f8e4138959f8733d215943e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.970868  5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ac2d94f8e4138959f8733d215943e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.970876  5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d4ac2d94f8e4138959f8733d215943e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:04.972229  5330 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: Bootstrap starting.
I20260928 13:03:04.972540  5331 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: Bootstrap starting.
I20260928 13:03:04.972836  5330 tablet_bootstrap.cc:654] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.972956  5331 tablet_bootstrap.cc:654] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.973290  5334 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: Bootstrap starting.
I20260928 13:03:04.973614  5330 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: No bootstrap required, opened a new log
I20260928 13:03:04.973670  5330 ts_tablet_manager.cc:1397] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:04.973716  5334 tablet_bootstrap.cc:654] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:04.973836  5330 raft_consensus.cc:348] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.973929  5330 raft_consensus.cc:374] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.973951  5330 raft_consensus.cc:729] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.974002  5330 consensus_queue.cc:260] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.974114  5330 ts_tablet_manager.cc:1428] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:04.974211  5337 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:04.974321  5337 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:04.974402  5334 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: No bootstrap required, opened a new log
I20260928 13:03:04.974427  5331 tablet_bootstrap.cc:492] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: No bootstrap required, opened a new log
I20260928 13:03:04.974467  5331 ts_tablet_manager.cc:1397] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:04.974457  5334 ts_tablet_manager.cc:1397] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:04.974776  5331 raft_consensus.cc:348] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.974779  5334 raft_consensus.cc:348] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.974850  5334 raft_consensus.cc:374] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.974850  5331 raft_consensus.cc:374] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:04.974874  5331 raft_consensus.cc:729] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.974874  5334 raft_consensus.cc:729] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Initialized, Role: FOLLOWER
I20260928 13:03:04.974916  5334 consensus_queue.cc:260] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.974916  5331 consensus_queue.cc:260] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:04.975031  5331 ts_tablet_manager.cc:1428] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:04.975030  5334 ts_tablet_manager.cc:1428] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:04.975136  5336 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:04.975253  5336 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:04.975385  5338 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:04.975472  5338 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:05.045641  5338 raft_consensus.cc:482] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:05.045784  5338 raft_consensus.cc:504] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.045976  5338 leader_election.cc:288] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:05.046267  5261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ac2d94f8e4138959f8733d215943e" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26" is_pre_election: true
I20260928 13:03:05.046265  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ac2d94f8e4138959f8733d215943e" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7" is_pre_election: true
I20260928 13:03:05.046381  5121 raft_consensus.cc:2454] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 0.
I20260928 13:03:05.046381  5261 raft_consensus.cc:2454] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 0.
I20260928 13:03:05.046556  4912 leader_election.cc:302] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 585ffb65b61b475bba1942a59c7b8a8a; no voters: 
I20260928 13:03:05.046684  5338 raft_consensus.cc:2781] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:05.046766  5338 raft_consensus.cc:482] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:05.046799  5338 raft_consensus.cc:3037] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.047600  5338 raft_consensus.cc:504] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.047775  5338 leader_election.cc:288] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 election: Requested vote from peers 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:05.048010  5261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ac2d94f8e4138959f8733d215943e" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26"
I20260928 13:03:05.048020  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d4ac2d94f8e4138959f8733d215943e" candidate_uuid: "585ffb65b61b475bba1942a59c7b8a8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7"
I20260928 13:03:05.048102  5121 raft_consensus.cc:3037] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.048102  5261 raft_consensus.cc:3037] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.048868  5261 raft_consensus.cc:2454] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 1.
I20260928 13:03:05.048868  5121 raft_consensus.cc:2454] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 585ffb65b61b475bba1942a59c7b8a8a in term 1.
I20260928 13:03:05.049059  4912 leader_election.cc:302] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 585ffb65b61b475bba1942a59c7b8a8a; no voters: 
I20260928 13:03:05.049197  5338 raft_consensus.cc:2781] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:05.049268  5338 raft_consensus.cc:686] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [term 1 LEADER]: Becoming Leader. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Running, Role: LEADER
I20260928 13:03:05.049321  5338 consensus_queue.cc:237] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.049672  5341 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: TxnStatusTablet state changed. Reason: New leader 585ffb65b61b475bba1942a59c7b8a8a. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.049765  5341 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:05.049966  5353 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 13:03:05.049961  4824 catalog_manager.cc:5495] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1). New cstate: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260928 13:03:05.050144  5353 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 13:03:05.071741  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.068634 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33036 (local address 127.3.6.1:37455)
0928 13:03:05.068696 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.068699 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.068709 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:05.068747 (+    38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.068748 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.068770 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.068847 (+    77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.069002 (+   155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.069774 (+   772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.070696 (+   922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.071048 (+   352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.071119 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.071298 (+   179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.071452 (+   154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.071535 (+    83us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.071630 (+    95us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.071651 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:03:05.071735  5348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.068339 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.0.0.1:33036)
0928 13:03:05.068432 (+    93us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.068446 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.068503 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.068869 (+   366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.068870 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.068871 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:05.068925 (+    54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.068927 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.069866 (+   939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.069867 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.070592 (+   725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.070595 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.071128 (+   533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.071131 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.071186 (+    55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.071201 (+    15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.071527 (+   326us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.071535 (+     8us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.071617 (+    82us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.071669 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260928 13:03:05.073820  5261 raft_consensus.cc:1261] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Refusing update from remote peer 585ffb65b61b475bba1942a59c7b8a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.073868  5121 raft_consensus.cc:1261] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Refusing update from remote peer 585ffb65b61b475bba1942a59c7b8a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.074218  5338 consensus_queue.cc:1035] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.074390  5341 consensus_queue.cc:1035] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.076448  5337 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: TxnStatusTablet state changed. Reason: New leader 585ffb65b61b475bba1942a59c7b8a8a. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.076540  5337 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:05.076731  5336 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: TxnStatusTablet state changed. Reason: New leader 585ffb65b61b475bba1942a59c7b8a8a. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.076838  5336 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:05.077800  5341 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.077878  5341 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:05.077931  5341 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.077968  5341 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 585ffb65b61b475bba1942a59c7b8a8a: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:05.078157  5336 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.078233  5336 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 73c0fa6f00724bf4a1ae1932211932a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:05.078220  5356 mvcc.cc:205] Tried to move back new op lower bound from 7334299996459454464 to 7334299996362362880. Current Snapshot: MvccSnapshot[applied={T|T < 7334299996459454464 or (T in {7334299996459454464})}]
I20260928 13:03:05.078742  5357 mvcc.cc:205] Tried to move back new op lower bound from 7334299996459454464 to 7334299996362362880. Current Snapshot: MvccSnapshot[applied={T|T < 7334299996459454464}]
I20260928 13:03:05.078861  5337 tablet_replica.cc:439] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "585ffb65b61b475bba1942a59c7b8a8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } } }
I20260928 13:03:05.078936  5337 tablet_replica.cc:442] T 8d4ac2d94f8e4138959f8733d215943e P 518c470ce786409e954a3b9536d71d26: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:05.079523  5359 mvcc.cc:205] Tried to move back new op lower bound from 7334299996459454464 to 7334299996362362880. Current Snapshot: MvccSnapshot[applied={T|T < 7334299996459454464}]
I20260928 13:03:05.082701  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.079972 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33048 (local address 127.3.6.1:37455)
0928 13:03:05.080013 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.080016 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.080048 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:03:05.080113 (+    65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.080113 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.080123 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.080169 (+    46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.080344 (+   175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.081055 (+   711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.081942 (+   887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.082268 (+   326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.082331 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.082476 (+   145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.082509 (+    33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.082562 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.082613 (+    51us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.082631 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:05.087846  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.085355 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47817 (local address 127.3.6.1:37455)
0928 13:03:05.085394 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.085396 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.085520 (+   124us) server_negotiation.cc:407] Connection header received
0928 13:03:05.085592 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.085593 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.085602 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.085649 (+    47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.085791 (+   142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.086245 (+   454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.087105 (+   860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.087290 (+   185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.087375 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.087586 (+   211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.087624 (+    38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.087679 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.087740 (+    61us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.087764 (+    24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":19}
I20260928 13:03:05.087918  5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.085247 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.3.6.1:47817)
0928 13:03:05.085439 (+   192us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.085450 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.085544 (+    94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.085649 (+   105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.085650 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.085668 (+    18us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:05.085718 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.085719 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.086325 (+   606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.086326 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.086973 (+   647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.086975 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.087373 (+   398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.087394 (+    21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.087460 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.087473 (+    13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.087693 (+   220us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.087695 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.087737 (+    42us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.087788 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":3,"thread_start_us":80,"threads_started":1}
I20260928 13:03:05.090512  5261 raft_consensus.cc:1261] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Refusing update from remote peer 585ffb65b61b475bba1942a59c7b8a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.090493  5121 raft_consensus.cc:1261] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Refusing update from remote peer 585ffb65b61b475bba1942a59c7b8a8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.090745  5341 consensus_queue.cc:1035] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.090849  5338 consensus_queue.cc:1035] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.103192  4824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:05.103329  4824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:05.104118  4824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Sending DeleteTablet for 3 replicas of tablet e5048737be3d4e47b47625f72f2fde6a
I20260928 13:03:05.104430  4960 tablet_service.cc:1514] Processing DeleteTablet for tablet e5048737be3d4e47b47625f72f2fde6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:05 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33034
I20260928 13:03:05.104539  5241 tablet_service.cc:1514] Processing DeleteTablet for tablet e5048737be3d4e47b47625f72f2fde6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:05 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42096
I20260928 13:03:05.104477  5101 tablet_service.cc:1514] Processing DeleteTablet for tablet e5048737be3d4e47b47625f72f2fde6a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:05 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33426
I20260928 13:03:05.104838  5374 tablet_replica.cc:330] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: stopping tablet replica
I20260928 13:03:05.104975  5374 raft_consensus.cc:2229] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:05.105059  5374 raft_consensus.cc:2258] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:05.104984  4824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:05.105144  4824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:05.105469  5373 tablet_replica.cc:330] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: stopping tablet replica
I20260928 13:03:05.105616  5374 ts_tablet_manager.cc:1905] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:05.105672  5373 raft_consensus.cc:2229] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:05.105827  5373 raft_consensus.cc:2258] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:05.106066  5372 tablet_replica.cc:330] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: stopping tablet replica
I20260928 13:03:05.106223  5372 raft_consensus.cc:2229] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:05.106381  5372 raft_consensus.cc:2258] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:05.106406  5373 ts_tablet_manager.cc:1905] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:05.106665  4960 tablet_service.cc:1467] Processing CreateTablet for tablet f583135bcbe74e42af5b26c0bb38c763 (DEFAULT_TABLE table=test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:05.106680  5101 tablet_service.cc:1467] Processing CreateTablet for tablet f583135bcbe74e42af5b26c0bb38c763 (DEFAULT_TABLE table=test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:05.106787  5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f583135bcbe74e42af5b26c0bb38c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:05.106787  4960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f583135bcbe74e42af5b26c0bb38c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:05.107827  5374 ts_tablet_manager.cc:1918] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:05.107898  5374 log.cc:1196] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/e5048737be3d4e47b47625f72f2fde6a
I20260928 13:03:05.108178  5374 ts_tablet_manager.cc:1939] T e5048737be3d4e47b47625f72f2fde6a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting consensus metadata
I20260928 13:03:05.108318  5373 ts_tablet_manager.cc:1918] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:05.108381  5373 log.cc:1196] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/e5048737be3d4e47b47625f72f2fde6a
I20260928 13:03:05.108539  5334 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Bootstrap starting.
I20260928 13:03:05.108551  5331 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Bootstrap starting.
I20260928 13:03:05.108631  5373 ts_tablet_manager.cc:1939] T e5048737be3d4e47b47625f72f2fde6a P 518c470ce786409e954a3b9536d71d26: Deleting consensus metadata
I20260928 13:03:05.108907  5334 tablet_bootstrap.cc:654] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:05.108963  5331 tablet_bootstrap.cc:654] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:05.109419  4811 catalog_manager.cc:4841] TS 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037): tablet e5048737be3d4e47b47625f72f2fde6a (table test-table [id=abb57b8075bb4c3a8116062efea80743]) successfully deleted
I20260928 13:03:05.109645  4808 catalog_manager.cc:4841] TS 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805): tablet e5048737be3d4e47b47625f72f2fde6a (table test-table [id=abb57b8075bb4c3a8116062efea80743]) successfully deleted
I20260928 13:03:05.109745  5241 tablet_service.cc:1467] Processing CreateTablet for tablet f583135bcbe74e42af5b26c0bb38c763 (DEFAULT_TABLE table=test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:05.109850  5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f583135bcbe74e42af5b26c0bb38c763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:05.109874  5334 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: No bootstrap required, opened a new log
I20260928 13:03:05.109915  5334 ts_tablet_manager.cc:1397] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:05.110075  5334 raft_consensus.cc:348] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.110143  5334 raft_consensus.cc:374] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:05.110164  5334 raft_consensus.cc:729] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Initialized, Role: FOLLOWER
I20260928 13:03:05.110214  5334 consensus_queue.cc:260] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.110307  5334 ts_tablet_manager.cc:1428] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:05.110769  5372 ts_tablet_manager.cc:1905] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:05.111166  5330 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Bootstrap starting.
I20260928 13:03:05.111539  5330 tablet_bootstrap.cc:654] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:05.113039  5372 ts_tablet_manager.cc:1918] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:05.113107  5331 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: No bootstrap required, opened a new log
I20260928 13:03:05.113161  5331 ts_tablet_manager.cc:1397] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.000s
I20260928 13:03:05.113170  5372 log.cc:1196] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/e5048737be3d4e47b47625f72f2fde6a
I20260928 13:03:05.113246  5330 tablet_bootstrap.cc:492] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: No bootstrap required, opened a new log
I20260928 13:03:05.113292  5330 ts_tablet_manager.cc:1397] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:05.113314  5331 raft_consensus.cc:348] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.113380  5331 raft_consensus.cc:374] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:05.113400  5331 raft_consensus.cc:729] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Initialized, Role: FOLLOWER
I20260928 13:03:05.113438  5331 consensus_queue.cc:260] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.113476  5372 ts_tablet_manager.cc:1939] T e5048737be3d4e47b47625f72f2fde6a P 585ffb65b61b475bba1942a59c7b8a8a: Deleting consensus metadata
I20260928 13:03:05.113444  5330 raft_consensus.cc:348] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.113515  5331 ts_tablet_manager.cc:1428] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:05.113515  5330 raft_consensus.cc:374] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:05.113548  5330 raft_consensus.cc:729] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Initialized, Role: FOLLOWER
I20260928 13:03:05.113601  5330 consensus_queue.cc:260] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.113684  5330 ts_tablet_manager.cc:1428] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:05.113943  4809 catalog_manager.cc:4841] TS 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455): tablet e5048737be3d4e47b47625f72f2fde6a (table test-table [id=abb57b8075bb4c3a8116062efea80743]) successfully deleted
I20260928 13:03:05.373544  5337 raft_consensus.cc:482] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:05.373648  5337 raft_consensus.cc:504] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.374111  5337 leader_election.cc:288] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037)
I20260928 13:03:05.377218  5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.374433 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:45927 (local address 127.3.6.2:36037)
0928 13:03:05.374479 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.374482 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.374640 (+   158us) server_negotiation.cc:407] Connection header received
0928 13:03:05.374732 (+    92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.374733 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.374743 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.374819 (+    76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:05.374986 (+   167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.375489 (+   503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376481 (+   992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.376852 (+   371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376935 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.376946 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.377109 (+   163us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.377145 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:03:05.377216  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.374466 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54379 (local address 127.3.6.1:37455)
0928 13:03:05.374524 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.374527 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.374610 (+    83us) server_negotiation.cc:407] Connection header received
0928 13:03:05.374700 (+    90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.374702 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.374712 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.374787 (+    75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:05.374953 (+   166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.375512 (+   559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376489 (+   977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.376854 (+   365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376936 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.376948 (+    12us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.377104 (+   156us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.377143 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260928 13:03:05.377223  5379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.374348 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.3.6.3:54379)
0928 13:03:05.374510 (+   162us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.374523 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.374625 (+   102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.374792 (+   167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.374792 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.374795 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:05.374883 (+    88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.374885 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.375642 (+   757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.375643 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.376384 (+   741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.376386 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.376936 (+   550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376937 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.377015 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.377019 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.377082 (+    63us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.377127 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260928 13:03:05.377235  5378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.374348 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:36037 (local address 127.3.6.3:45927)
0928 13:03:05.374536 (+   188us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.374546 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.374651 (+   105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.374834 (+   183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.374835 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.374838 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:05.374903 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.374905 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.375585 (+   680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.375587 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.376384 (+   797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.376386 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.376947 (+   561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.376948 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.377017 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.377023 (+     6us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.377101 (+    78us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.377142 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":2,"spinlock_wait_cycles":896,"thread_start_us":77,"threads_started":1}
I20260928 13:03:05.377570  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f583135bcbe74e42af5b26c0bb38c763" candidate_uuid: "518c470ce786409e954a3b9536d71d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a" is_pre_election: true
I20260928 13:03:05.377671  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f583135bcbe74e42af5b26c0bb38c763" candidate_uuid: "518c470ce786409e954a3b9536d71d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7" is_pre_election: true
I20260928 13:03:05.377717  4981 raft_consensus.cc:2454] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518c470ce786409e954a3b9536d71d26 in term 0.
I20260928 13:03:05.377784  5121 raft_consensus.cc:2454] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 518c470ce786409e954a3b9536d71d26 in term 0.
I20260928 13:03:05.377940  5193 leader_election.cc:302] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 585ffb65b61b475bba1942a59c7b8a8a; no voters: 
I20260928 13:03:05.378063  5337 raft_consensus.cc:2781] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:05.378103  5337 raft_consensus.cc:482] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:05.378131  5337 raft_consensus.cc:3037] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.378822  5337 raft_consensus.cc:504] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.378975  5337 leader_election.cc:288] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [CANDIDATE]: Term 1 election: Requested vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037)
I20260928 13:03:05.379148  5121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f583135bcbe74e42af5b26c0bb38c763" candidate_uuid: "518c470ce786409e954a3b9536d71d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73c0fa6f00724bf4a1ae1932211932a7"
I20260928 13:03:05.379232  5121 raft_consensus.cc:3037] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.379184  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f583135bcbe74e42af5b26c0bb38c763" candidate_uuid: "518c470ce786409e954a3b9536d71d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a"
I20260928 13:03:05.379272  4981 raft_consensus.cc:3037] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:05.379962  5121 raft_consensus.cc:2454] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c470ce786409e954a3b9536d71d26 in term 1.
I20260928 13:03:05.380064  4981 raft_consensus.cc:2454] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 518c470ce786409e954a3b9536d71d26 in term 1.
I20260928 13:03:05.380144  5195 leader_election.cc:302] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 73c0fa6f00724bf4a1ae1932211932a7; no voters: 
I20260928 13:03:05.380300  5337 raft_consensus.cc:2781] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:05.380430  5337 raft_consensus.cc:686] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 1 LEADER]: Becoming Leader. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Running, Role: LEADER
I20260928 13:03:05.380494  5337 consensus_queue.cc:237] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:05.381136  4823 catalog_manager.cc:5495] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 518c470ce786409e954a3b9536d71d26 (127.3.6.3). New cstate: current_term: 1 leader_uuid: "518c470ce786409e954a3b9536d71d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:05.397382  5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.394930 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42106 (local address 127.3.6.3:41805)
0928 13:03:05.394973 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.394974 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.394986 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:05.395095 (+   109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.395096 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.395116 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.395208 (+    92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.395321 (+   113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.395793 (+   472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.396573 (+   780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.396784 (+   211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.396866 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.397022 (+   156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.397136 (+   114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.397219 (+    83us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.397258 (+    39us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.397280 (+    22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:05.401993  5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.399903 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:42307 (local address 127.3.6.1:37455)
0928 13:03:05.399950 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.399952 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.400030 (+    78us) server_negotiation.cc:407] Connection header received
0928 13:03:05.400079 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.400080 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.400088 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.400133 (+    45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.400218 (+    85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.400652 (+   434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.401342 (+   690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.401563 (+   221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.401616 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.401755 (+   139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.401780 (+    25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.401819 (+    39us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.401925 (+   106us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.401940 (+    15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:05.402043  5384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.399820 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.3.6.3:42307)
0928 13:03:05.399982 (+   162us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.399991 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.400040 (+    49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.400134 (+    94us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.400135 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.400136 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:05.400176 (+    40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.400177 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.400711 (+   534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.400711 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.401274 (+   563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.401276 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.401629 (+   353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.401631 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.401674 (+    43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.401687 (+    13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.401864 (+   177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.401867 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.401922 (+    55us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.401958 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260928 13:03:05.404095  5121 raft_consensus.cc:1261] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Refusing update from remote peer 518c470ce786409e954a3b9536d71d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.404139  4981 raft_consensus.cc:1261] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Refusing update from remote peer 518c470ce786409e954a3b9536d71d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:05.404366  5337 consensus_queue.cc:1035] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.404702  5380 consensus_queue.cc:1035] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:05.411877  5327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.409560 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:35553 (local address 127.3.6.3:41805)
0928 13:03:05.409597 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:05.409599 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:05.409606 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:05.409626 (+    20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:05.409626 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:05.409637 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:05.409716 (+    79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:05.409825 (+   109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.410321 (+   496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.411004 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.411343 (+   339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.411432 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.411644 (+   212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.411677 (+    33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.411729 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:05.411797 (+    68us) server_negotiation.cc:299] Negotiation successful
0928 13:03:05.411814 (+    17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:03:05.411914  5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:05.409458 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41805 (local address 127.3.6.1:35553)
0928 13:03:05.409515 (+    57us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:05.409527 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:05.409569 (+    42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:05.409727 (+   158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:05.409728 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:05.409729 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:05.409768 (+    39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.409770 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.410384 (+   614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.410385 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.410925 (+   540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:05.410926 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:05.411432 (+   506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:05.411434 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:05.411492 (+    58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:05.411505 (+    13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:05.411740 (+   235us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:05.411742 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:05.411792 (+    50us) client_negotiation.cc:240] Negotiation successful
0928 13:03:05.411838 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
W20260928 13:03:05.412230  5357 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260928 13:03:06.930855  4823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:06.930964  4823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:06.931880  4823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Sending DeleteTablet for 3 replicas of tablet f583135bcbe74e42af5b26c0bb38c763
I20260928 13:03:06.932173  4960 tablet_service.cc:1514] Processing DeleteTablet for tablet f583135bcbe74e42af5b26c0bb38c763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:06 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33034
I20260928 13:03:06.932180  5241 tablet_service.cc:1514] Processing DeleteTablet for tablet f583135bcbe74e42af5b26c0bb38c763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:06 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42096
I20260928 13:03:06.932204  5101 tablet_service.cc:1514] Processing DeleteTablet for tablet f583135bcbe74e42af5b26c0bb38c763 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:06 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33426
I20260928 13:03:06.932608  5410 tablet_replica.cc:330] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: stopping tablet replica
I20260928 13:03:06.932667  5410 raft_consensus.cc:2229] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:06.932704  5410 raft_consensus.cc:2258] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:06.932982  5410 ts_tablet_manager.cc:1905] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:06.934919  5410 ts_tablet_manager.cc:1918] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 13:03:06.934988  5410 log.cc:1196] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/f583135bcbe74e42af5b26c0bb38c763
I20260928 13:03:06.935289  5410 ts_tablet_manager.cc:1939] T f583135bcbe74e42af5b26c0bb38c763 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting consensus metadata
I20260928 13:03:06.935299  5411 tablet_replica.cc:330] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: stopping tablet replica
I20260928 13:03:06.935357  5411 raft_consensus.cc:2229] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:06.935408  5411 raft_consensus.cc:2258] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:06.935524  5409 tablet_replica.cc:330] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: stopping tablet replica
I20260928 13:03:06.935598  5409 raft_consensus.cc:2229] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:06.935699  4811 catalog_manager.cc:4841] TS 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037): tablet f583135bcbe74e42af5b26c0bb38c763 (table test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]) successfully deleted
I20260928 13:03:06.935741  5409 raft_consensus.cc:2258] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:06.935817  5411 ts_tablet_manager.cc:1905] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:06.935958  5409 ts_tablet_manager.cc:1905] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:06.937398  5411 ts_tablet_manager.cc:1918] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 13:03:06.937410  5409 ts_tablet_manager.cc:1918] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 13:03:06.937466  5409 log.cc:1196] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/f583135bcbe74e42af5b26c0bb38c763
I20260928 13:03:06.937466  5411 log.cc:1196] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/f583135bcbe74e42af5b26c0bb38c763
I20260928 13:03:06.937695  5411 ts_tablet_manager.cc:1939] T f583135bcbe74e42af5b26c0bb38c763 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting consensus metadata
I20260928 13:03:06.937711  5409 ts_tablet_manager.cc:1939] T f583135bcbe74e42af5b26c0bb38c763 P 518c470ce786409e954a3b9536d71d26: Deleting consensus metadata
I20260928 13:03:06.938030  4809 catalog_manager.cc:4841] TS 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455): tablet f583135bcbe74e42af5b26c0bb38c763 (table test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]) successfully deleted
I20260928 13:03:06.938112  4808 catalog_manager.cc:4841] TS 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805): tablet f583135bcbe74e42af5b26c0bb38c763 (table test-table [id=4343a6c866be4f8eb12c85d818a4fdd2]) successfully deleted
Sep 28 13:03:06 dist-test-slave-ddvw krb5kdc[4779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Sep 28 13:03:06 dist-test-slave-ddvw krb5kdc[4779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600586, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:06.964896  5419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:06.951394 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52716 (local address 127.3.6.62:43475)
0928 13:03:06.951654 (+   260us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:06.951715 (+    61us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:06.951726 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:06.951754 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:06.951755 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:06.951767 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:06.951882 (+   115us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:06.952513 (+   631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:06.953047 (+   534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:06.953845 (+   798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:06.954054 (+   209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:06.954142 (+    88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:06.962215 (+  8073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:06.962217 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:06.962218 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:06.962225 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:06.963645 (+  1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:06.964039 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:06.964040 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:06.964041 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:06.964106 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:06.964342 (+   236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:06.964343 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:06.964344 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:06.964468 (+   124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:06.964640 (+   172us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:06.964683 (+    43us) server_negotiation.cc:299] Negotiation successful
0928 13:03:06.964778 (+    95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":92,"threads_started":1}
I20260928 13:03:06.966430  4823 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:06.966632  4823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:06.968110  5101 tablet_service.cc:1467] Processing CreateTablet for tablet b60259b9cae142e4858684c19042b914 (DEFAULT_TABLE table=test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:06.968110  4960 tablet_service.cc:1467] Processing CreateTablet for tablet b60259b9cae142e4858684c19042b914 (DEFAULT_TABLE table=test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:06.968134  5241 tablet_service.cc:1467] Processing CreateTablet for tablet b60259b9cae142e4858684c19042b914 (DEFAULT_TABLE table=test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:06.968250  5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60259b9cae142e4858684c19042b914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:06.968252  4960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60259b9cae142e4858684c19042b914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:06.968276  5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b60259b9cae142e4858684c19042b914. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:06.969331  5420 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Bootstrap starting.
I20260928 13:03:06.969692  5420 tablet_bootstrap.cc:654] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:06.969686  5421 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Bootstrap starting.
I20260928 13:03:06.970052  5421 tablet_bootstrap.cc:654] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:06.970347  5420 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: No bootstrap required, opened a new log
I20260928 13:03:06.970374  5422 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Bootstrap starting.
I20260928 13:03:06.970400  5420 ts_tablet_manager.cc:1397] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:06.970561  5420 raft_consensus.cc:348] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.970641  5421 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: No bootstrap required, opened a new log
I20260928 13:03:06.970655  5420 raft_consensus.cc:374] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:06.970681  5420 raft_consensus.cc:729] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Initialized, Role: FOLLOWER
I20260928 13:03:06.970683  5421 ts_tablet_manager.cc:1397] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:06.970758  5420 consensus_queue.cc:260] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.970789  5422 tablet_bootstrap.cc:654] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:06.970878  5420 ts_tablet_manager.cc:1428] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:06.970849  5421 raft_consensus.cc:348] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.970920  5421 raft_consensus.cc:374] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:06.970983  5421 raft_consensus.cc:729] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Initialized, Role: FOLLOWER
I20260928 13:03:06.971084  5421 consensus_queue.cc:260] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.971201  5421 ts_tablet_manager.cc:1428] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:06.971647  5422 tablet_bootstrap.cc:492] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: No bootstrap required, opened a new log
I20260928 13:03:06.971743  5422 ts_tablet_manager.cc:1397] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:06.971926  5422 raft_consensus.cc:348] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.972002  5422 raft_consensus.cc:374] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:06.972016  5422 raft_consensus.cc:729] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Initialized, Role: FOLLOWER
I20260928 13:03:06.972067  5422 consensus_queue.cc:260] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:06.972239  5422 ts_tablet_manager.cc:1428] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:07.108636  5426 raft_consensus.cc:482] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:07.108741  5426 raft_consensus.cc:504] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.109246  5426 leader_election.cc:288] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:07.113684  5427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.109442 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.3.6.2:34337)
0928 13:03:07.109635 (+   193us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:07.109648 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:07.109717 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:07.109927 (+   210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:07.109928 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:07.109930 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:07.110035 (+   105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.110036 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.111181 (+  1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.111182 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.112576 (+  1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.112579 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.113408 (+   829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.113409 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.113475 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.113478 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:07.113545 (+    67us) client_negotiation.cc:240] Negotiation successful
0928 13:03:07.113592 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":114,"thread_start_us":120,"threads_started":1}
I20260928 13:03:07.113742  5430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.109514 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:34337 (local address 127.3.6.1:37455)
0928 13:03:07.109664 (+   150us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:07.109666 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:07.109705 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:07.109820 (+   115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:07.109821 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:07.109833 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:07.109903 (+    70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:07.110178 (+   275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.111096 (+   918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.112673 (+  1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.113273 (+   600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.113379 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.113393 (+    14us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:07.113605 (+   212us) server_negotiation.cc:299] Negotiation successful
0928 13:03:07.113660 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":88,"threads_started":1}
I20260928 13:03:07.113991  5428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.109442 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41805 (local address 127.3.6.2:53825)
0928 13:03:07.109635 (+   193us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:07.109648 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:07.109733 (+    85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:07.109927 (+   194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:07.109928 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:07.109932 (+     4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:07.110018 (+    86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.110021 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.111181 (+  1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.111182 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.112839 (+  1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.112841 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.113701 (+   860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.113702 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.113780 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.113785 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:07.113841 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:03:07.113893 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":71,"spinlock_wait_cycles":768,"thread_start_us":121,"threads_started":1}
I20260928 13:03:07.114218  5429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.109512 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:53825 (local address 127.3.6.3:41805)
0928 13:03:07.109679 (+   167us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:07.109681 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:07.109696 (+    15us) server_negotiation.cc:407] Connection header received
0928 13:03:07.109810 (+   114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:07.109811 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:07.109824 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:07.109903 (+    79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:07.110184 (+   281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.111072 (+   888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.112926 (+  1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.113580 (+   654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.113650 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.113661 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:07.114037 (+   376us) server_negotiation.cc:299] Negotiation successful
0928 13:03:07.114118 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":94,"threads_started":1}
I20260928 13:03:07.114295  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60259b9cae142e4858684c19042b914" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a" is_pre_election: true
I20260928 13:03:07.114399  4981 raft_consensus.cc:2454] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 0.
I20260928 13:03:07.114496  5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60259b9cae142e4858684c19042b914" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26" is_pre_election: true
I20260928 13:03:07.114603  5053 leader_election.cc:302] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 585ffb65b61b475bba1942a59c7b8a8a, 73c0fa6f00724bf4a1ae1932211932a7; no voters: 
I20260928 13:03:07.114634  5259 raft_consensus.cc:2454] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 0.
I20260928 13:03:07.114741  5426 raft_consensus.cc:2781] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:07.114790  5426 raft_consensus.cc:482] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:07.114811  5426 raft_consensus.cc:3037] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.115494  5426 raft_consensus.cc:504] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.115638  5426 leader_election.cc:288] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 election: Requested vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:07.115789  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60259b9cae142e4858684c19042b914" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a"
I20260928 13:03:07.115880  4981 raft_consensus.cc:3037] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.115953  5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b60259b9cae142e4858684c19042b914" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26"
I20260928 13:03:07.116046  5259 raft_consensus.cc:3037] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.116536  4981 raft_consensus.cc:2454] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 1.
I20260928 13:03:07.116720  5053 leader_election.cc:302] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 585ffb65b61b475bba1942a59c7b8a8a, 73c0fa6f00724bf4a1ae1932211932a7; no voters: 
I20260928 13:03:07.116755  5259 raft_consensus.cc:2454] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 1.
I20260928 13:03:07.116815  5426 raft_consensus.cc:2781] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:07.116972  5426 raft_consensus.cc:686] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 LEADER]: Becoming Leader. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Running, Role: LEADER
I20260928 13:03:07.117049  5426 consensus_queue.cc:237] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.117777  4824 catalog_manager.cc:5495] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "73c0fa6f00724bf4a1ae1932211932a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260928 13:03:07.156445  5434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.153836 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33442 (local address 127.3.6.2:36037)
0928 13:03:07.154010 (+   174us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:07.154012 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:07.154018 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:07.154052 (+    34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:07.154052 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:07.154070 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:07.154163 (+    93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:07.154290 (+   127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.154787 (+   497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.155631 (+   844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.155843 (+   212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.155921 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.156062 (+   141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:07.156184 (+   122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:07.156273 (+    89us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:07.156312 (+    39us) server_negotiation.cc:299] Negotiation successful
0928 13:03:07.156332 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":96,"threads_started":1}
I20260928 13:03:07.161334  5430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.158977 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:43145 (local address 127.3.6.1:37455)
0928 13:03:07.159042 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:07.159044 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:07.159083 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:07.159146 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:07.159148 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:07.159158 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:07.159193 (+    35us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:07.159401 (+   208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.159950 (+   549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.160674 (+   724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.160861 (+   187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.160914 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.161102 (+   188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:07.161135 (+    33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:07.161184 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:07.161251 (+    67us) server_negotiation.cc:299] Negotiation successful
0928 13:03:07.161272 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 13:03:07.161360  5437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.158815 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.3.6.2:43145)
0928 13:03:07.158975 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:07.158985 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:07.159091 (+   106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:07.159206 (+   115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:07.159207 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:07.159209 (+     2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:07.159262 (+    53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.159264 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.160027 (+   763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.160028 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.160597 (+   569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.160599 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.160932 (+   333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.160935 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.160984 (+    49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.161000 (+    16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:07.161207 (+   207us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:07.161209 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:07.161242 (+    33us) client_negotiation.cc:240] Negotiation successful
0928 13:03:07.161280 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
I20260928 13:03:07.163849  5259 raft_consensus.cc:1261] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Refusing update from remote peer 73c0fa6f00724bf4a1ae1932211932a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:07.163877  4981 raft_consensus.cc:1261] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Refusing update from remote peer 73c0fa6f00724bf4a1ae1932211932a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:07.164149  5431 consensus_queue.cc:1035] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:07.164299  5426 consensus_queue.cc:1035] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:07.171519  5434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.169003 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:59081 (local address 127.3.6.2:36037)
0928 13:03:07.169040 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:07.169042 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:07.169197 (+   155us) server_negotiation.cc:407] Connection header received
0928 13:03:07.169253 (+    56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:07.169254 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:07.169265 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:07.169318 (+    53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:07.169405 (+    87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.169870 (+   465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.170737 (+   867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.171075 (+   338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.171137 (+    62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.171319 (+   182us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:07.171356 (+    37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:07.171411 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:07.171443 (+    32us) server_negotiation.cc:299] Negotiation successful
0928 13:03:07.171463 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:03:07.171545  5442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:07.168960 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:36037 (local address 127.3.6.1:59081)
0928 13:03:07.169118 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:07.169130 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:07.169193 (+    63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:07.169324 (+   131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:07.169325 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:07.169326 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:07.169367 (+    41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.169369 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.169977 (+   608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.169977 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.170590 (+   613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:07.170592 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:07.171134 (+   542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:07.171138 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:07.171202 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:07.171207 (+     5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:07.171406 (+   199us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:07.171407 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:07.171442 (+    35us) client_negotiation.cc:240] Negotiation successful
0928 13:03:07.171483 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260928 13:03:07.178107  4824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:07.178225  4824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:07.178838  4824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Sending DeleteTablet for 3 replicas of tablet b60259b9cae142e4858684c19042b914
I20260928 13:03:07.179095  4960 tablet_service.cc:1514] Processing DeleteTablet for tablet b60259b9cae142e4858684c19042b914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:07 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33034
I20260928 13:03:07.179208  5101 tablet_service.cc:1514] Processing DeleteTablet for tablet b60259b9cae142e4858684c19042b914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:07 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33426
I20260928 13:03:07.179221  5411 tablet_replica.cc:330] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: stopping tablet replica
I20260928 13:03:07.179207  5241 tablet_service.cc:1514] Processing DeleteTablet for tablet b60259b9cae142e4858684c19042b914 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:07 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42096
I20260928 13:03:07.179288  5411 raft_consensus.cc:2229] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:07.179296  5409 tablet_replica.cc:330] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: stopping tablet replica
I20260928 13:03:07.179296  5410 tablet_replica.cc:330] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: stopping tablet replica
I20260928 13:03:07.179342  5411 raft_consensus.cc:2258] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:07.179343  5410 raft_consensus.cc:2229] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:07.179352  5409 raft_consensus.cc:2229] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:07.179390  5409 raft_consensus.cc:2258] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:07.179428  5410 raft_consensus.cc:2258] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:07.179684  5409 ts_tablet_manager.cc:1905] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:07.179803  5411 ts_tablet_manager.cc:1905] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:07.179804  5410 ts_tablet_manager.cc:1905] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:07.181354  5410 ts_tablet_manager.cc:1918] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:07.181372  5409 ts_tablet_manager.cc:1918] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:07.181417  5410 log.cc:1196] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/b60259b9cae142e4858684c19042b914
I20260928 13:03:07.181425  5409 log.cc:1196] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/b60259b9cae142e4858684c19042b914
I20260928 13:03:07.181432  4824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:07.181589  4824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:07.181656  5410 ts_tablet_manager.cc:1939] T b60259b9cae142e4858684c19042b914 P 73c0fa6f00724bf4a1ae1932211932a7: Deleting consensus metadata
I20260928 13:03:07.181702  5409 ts_tablet_manager.cc:1939] T b60259b9cae142e4858684c19042b914 P 518c470ce786409e954a3b9536d71d26: Deleting consensus metadata
I20260928 13:03:07.182032  4808 catalog_manager.cc:4841] TS 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805): tablet b60259b9cae142e4858684c19042b914 (table test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]) successfully deleted
I20260928 13:03:07.182211  5411 ts_tablet_manager.cc:1918] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:07.182264  5411 log.cc:1196] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/b60259b9cae142e4858684c19042b914
I20260928 13:03:07.182468  5411 ts_tablet_manager.cc:1939] T b60259b9cae142e4858684c19042b914 P 585ffb65b61b475bba1942a59c7b8a8a: Deleting consensus metadata
I20260928 13:03:07.182868  4809 catalog_manager.cc:4841] TS 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455): tablet b60259b9cae142e4858684c19042b914 (table test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]) successfully deleted
I20260928 13:03:07.182957  4960 tablet_service.cc:1467] Processing CreateTablet for tablet 3010134076b6496b9a8d5c5587d1214a (DEFAULT_TABLE table=test-table [id=bab91b4c5988444db8f92fe54fa1d354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:07.183091  4960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3010134076b6496b9a8d5c5587d1214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:07.183120  5241 tablet_service.cc:1467] Processing CreateTablet for tablet 3010134076b6496b9a8d5c5587d1214a (DEFAULT_TABLE table=test-table [id=bab91b4c5988444db8f92fe54fa1d354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:07.183212  5241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3010134076b6496b9a8d5c5587d1214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:07.183204  4811 catalog_manager.cc:4841] TS 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037): tablet b60259b9cae142e4858684c19042b914 (table test-table [id=6803f055f3d5419ca2eb1bb2eb5934f7]) successfully deleted
I20260928 13:03:07.183315  5101 tablet_service.cc:1467] Processing CreateTablet for tablet 3010134076b6496b9a8d5c5587d1214a (DEFAULT_TABLE table=test-table [id=bab91b4c5988444db8f92fe54fa1d354]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:07.183408  5101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3010134076b6496b9a8d5c5587d1214a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:07.184407  5421 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a: Bootstrap starting.
I20260928 13:03:07.184602  5420 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Bootstrap starting.
I20260928 13:03:07.184733  5421 tablet_bootstrap.cc:654] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:07.184921  5420 tablet_bootstrap.cc:654] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:07.185158  5422 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Bootstrap starting.
I20260928 13:03:07.185330  5421 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a: No bootstrap required, opened a new log
I20260928 13:03:07.185386  5421 ts_tablet_manager.cc:1397] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:07.185498  5421 raft_consensus.cc:348] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.185572  5422 tablet_bootstrap.cc:654] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:07.185592  5421 raft_consensus.cc:374] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:07.185617  5421 raft_consensus.cc:729] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 585ffb65b61b475bba1942a59c7b8a8a, State: Initialized, Role: FOLLOWER
I20260928 13:03:07.185671  5421 consensus_queue.cc:260] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.185778  5421 ts_tablet_manager.cc:1428] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:07.186213  5420 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: No bootstrap required, opened a new log
I20260928 13:03:07.186264  5420 ts_tablet_manager.cc:1397] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:07.186362  5420 raft_consensus.cc:348] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.186431  5420 raft_consensus.cc:374] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:07.186456  5420 raft_consensus.cc:729] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 518c470ce786409e954a3b9536d71d26, State: Initialized, Role: FOLLOWER
I20260928 13:03:07.186507  5420 consensus_queue.cc:260] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.186609  5420 ts_tablet_manager.cc:1428] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:07.187150  5422 tablet_bootstrap.cc:492] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: No bootstrap required, opened a new log
I20260928 13:03:07.187206  5422 ts_tablet_manager.cc:1397] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:07.187336  5422 raft_consensus.cc:348] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.187407  5422 raft_consensus.cc:374] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:07.187429  5422 raft_consensus.cc:729] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Initialized, Role: FOLLOWER
I20260928 13:03:07.187474  5422 consensus_queue.cc:260] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.187605  5422 ts_tablet_manager.cc:1428] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:07.323927  5431 raft_consensus.cc:482] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:07.324052  5431 raft_consensus.cc:504] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.324283  5431 leader_election.cc:288] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:07.324504  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3010134076b6496b9a8d5c5587d1214a" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a" is_pre_election: true
I20260928 13:03:07.324654  4981 raft_consensus.cc:2454] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 0.
I20260928 13:03:07.324664  5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3010134076b6496b9a8d5c5587d1214a" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26" is_pre_election: true
I20260928 13:03:07.324832  5259 raft_consensus.cc:2454] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 0.
I20260928 13:03:07.324935  5053 leader_election.cc:302] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 585ffb65b61b475bba1942a59c7b8a8a, 73c0fa6f00724bf4a1ae1932211932a7; no voters: 
I20260928 13:03:07.325052  5431 raft_consensus.cc:2781] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:07.325107  5431 raft_consensus.cc:482] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:07.325122  5431 raft_consensus.cc:3037] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.325894  5431 raft_consensus.cc:504] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.326061  5431 leader_election.cc:288] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 election: Requested vote from peers 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455), 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805)
I20260928 13:03:07.326198  4981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3010134076b6496b9a8d5c5587d1214a" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "585ffb65b61b475bba1942a59c7b8a8a"
I20260928 13:03:07.326251  5259 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3010134076b6496b9a8d5c5587d1214a" candidate_uuid: "73c0fa6f00724bf4a1ae1932211932a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "518c470ce786409e954a3b9536d71d26"
I20260928 13:03:07.326305  4981 raft_consensus.cc:3037] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.326339  5259 raft_consensus.cc:3037] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:07.326973  5259 raft_consensus.cc:2454] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 1.
I20260928 13:03:07.326970  4981 raft_consensus.cc:2454] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73c0fa6f00724bf4a1ae1932211932a7 in term 1.
I20260928 13:03:07.327191  5052 leader_election.cc:302] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 518c470ce786409e954a3b9536d71d26, 73c0fa6f00724bf4a1ae1932211932a7; no voters: 
I20260928 13:03:07.327302  5431 raft_consensus.cc:2781] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:07.327355  5431 raft_consensus.cc:686] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 LEADER]: Becoming Leader. State: Replica: 73c0fa6f00724bf4a1ae1932211932a7, State: Running, Role: LEADER
I20260928 13:03:07.327423  5431 consensus_queue.cc:237] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } }
I20260928 13:03:07.328012  4824 catalog_manager.cc:5495] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "73c0fa6f00724bf4a1ae1932211932a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "73c0fa6f00724bf4a1ae1932211932a7" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 36037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260928 13:03:07.337419  4981 raft_consensus.cc:1261] T 3010134076b6496b9a8d5c5587d1214a P 585ffb65b61b475bba1942a59c7b8a8a [term 1 FOLLOWER]: Refusing update from remote peer 73c0fa6f00724bf4a1ae1932211932a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:07.337441  5259 raft_consensus.cc:1261] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Refusing update from remote peer 73c0fa6f00724bf4a1ae1932211932a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:07.337657  5431 consensus_queue.cc:1035] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "585ffb65b61b475bba1942a59c7b8a8a" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:07.337773  5426 consensus_queue.cc:1035] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "518c470ce786409e954a3b9536d71d26" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 13:03:07.342444  5393 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260928 13:03:08.862106  4823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:08.862234  4823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52716:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:08.863076  4823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 40cd8195c5624746aa75ab325c98370e: Sending DeleteTablet for 3 replicas of tablet 3010134076b6496b9a8d5c5587d1214a
I20260928 13:03:08.863328  5101 tablet_service.cc:1514] Processing DeleteTablet for tablet 3010134076b6496b9a8d5c5587d1214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:08 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33426
I20260928 13:03:08.863385  5241 tablet_service.cc:1514] Processing DeleteTablet for tablet 3010134076b6496b9a8d5c5587d1214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:08 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42096
I20260928 13:03:08.863449  4960 tablet_service.cc:1514] Processing DeleteTablet for tablet 3010134076b6496b9a8d5c5587d1214a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:08 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:33034
I20260928 13:03:08.863569  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4896
I20260928 13:03:08.864842  5471 tablet_replica.cc:330] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: stopping tablet replica
I20260928 13:03:08.864931  5471 raft_consensus.cc:2229] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:08.864985  5471 raft_consensus.cc:2258] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:08.865239  5471 ts_tablet_manager.cc:1905] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:08.866882  5471 ts_tablet_manager.cc:1918] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 13:03:08.866950  5471 log.cc:1196] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/3010134076b6496b9a8d5c5587d1214a
I20260928 13:03:08.867111  5470 tablet_replica.cc:330] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: stopping tablet replica
I20260928 13:03:08.867187  5470 raft_consensus.cc:2229] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:08.867260  5471 ts_tablet_manager.cc:1939] T 3010134076b6496b9a8d5c5587d1214a P 518c470ce786409e954a3b9536d71d26: Deleting consensus metadata
I20260928 13:03:08.867305  5470 raft_consensus.cc:2258] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:08.867614  5470 ts_tablet_manager.cc:1905] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:08.867659  4808 catalog_manager.cc:4841] TS 518c470ce786409e954a3b9536d71d26 (127.3.6.3:41805): tablet 3010134076b6496b9a8d5c5587d1214a (table test-table [id=bab91b4c5988444db8f92fe54fa1d354]) successfully deleted
I20260928 13:03:08.868932  5470 ts_tablet_manager.cc:1918] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 13:03:08.868983  5470 log.cc:1196] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/3010134076b6496b9a8d5c5587d1214a
I20260928 13:03:08.869223  5470 ts_tablet_manager.cc:1939] T 3010134076b6496b9a8d5c5587d1214a P 73c0fa6f00724bf4a1ae1932211932a7: Deleting consensus metadata
I20260928 13:03:08.869575  4811 catalog_manager.cc:4841] TS 73c0fa6f00724bf4a1ae1932211932a7 (127.3.6.2:36037): tablet 3010134076b6496b9a8d5c5587d1214a (table test-table [id=bab91b4c5988444db8f92fe54fa1d354]) successfully deleted
W20260928 13:03:08.870627  4809 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:37455 (error 108)
I20260928 13:03:08.870918  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5036
I20260928 13:03:08.875268  5474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:08.871090 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37455 (local address 127.0.0.1:33056)
0928 13:03:08.875155 (+  4065us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:08.875223 (+    68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4023,"thread_start_us":74,"threads_started":1}
W20260928 13:03:08.875427  4809 catalog_manager.cc:4584] TS 585ffb65b61b475bba1942a59c7b8a8a (127.3.6.1:37455): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3010134076b6496b9a8d5c5587d1214a: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37455: connect: Connection refused (error 111)
I20260928 13:03:08.878285  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5176
I20260928 13:03:08.884680  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 4792
2026-09-28T13:03:08Z chronyd exiting
[       OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6038 ms)
[ RUN      ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:08 dist-test-slave-ddvw krb5kdc[5477](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:08 dist-test-slave-ddvw krb5kdc[5477](info): set up 2 sockets
Sep 28 13:03:08 dist-test-slave-ddvw krb5kdc[5477](info): commencing operation
krb5kdc: starting...
W20260928 13:03:09.955252  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.048s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:10.074165  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37225
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37225
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:10.154703  5490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:10.154932  5490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:10.154955  5490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:10.156178  5490 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:10.156229  5490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:10.156243  5490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:10.156256  5490 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:10.156270  5490 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:10.157691  5490 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:10.157891  5490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:10.158069  5490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:10.162843  5498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.162869  5496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.162843  5495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:10.163260  5490 server_base.cc:1034] running on GCE node
I20260928 13:03:10.163527  5490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:10.163826  5490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:10.164995  5490 hybrid_clock.cc:648] HybridClock initialized: now 1790600590164985 us; error 45 us; skew 500 ppm
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:10.167588  5490 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:10.168093  5490 webserver.cc:460] Webserver started at http://127.3.6.62:45291/ using document root <none> and password file <none>
I20260928 13:03:10.168325  5490 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:10.168394  5490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:10.168548  5490 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:10.169672  5490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "ea4044e955584568a7a78d191803537e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "0c53cbe9512cf77222ec2be4eaf2b2df"
server_key_iv: "f8af8c6fbe679cf7d30e5b02d1e87a16"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.170056  5490 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "ea4044e955584568a7a78d191803537e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "0c53cbe9512cf77222ec2be4eaf2b2df"
server_key_iv: "f8af8c6fbe679cf7d30e5b02d1e87a16"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.171602  5490 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:10.172426  5505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.172711  5490 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:10.172832  5490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "ea4044e955584568a7a78d191803537e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "0c53cbe9512cf77222ec2be4eaf2b2df"
server_key_iv: "f8af8c6fbe679cf7d30e5b02d1e87a16"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.172915  5490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:10.198359  5490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:10.200969  5490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:10.201154  5490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:10.205291  5490 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:37225
I20260928 13:03:10.205334  5557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:37225 every 8 connection(s)
I20260928 13:03:10.205726  5490 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:10.206629  5558 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:10.209395  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5490
I20260928 13:03:10.209507  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:10.209678  3096 external_mini_cluster.cc:1428] Setting key 2679e1c37b06dd5808c601cec0d898f5
I20260928 13:03:10.209650  5558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e: Bootstrap starting.
I20260928 13:03:10.210466  5558 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:10.210860  5558 log.cc:824] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:10.211687  5558 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e: No bootstrap required, opened a new log
I20260928 13:03:10.214169  5558 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } }
I20260928 13:03:10.214396  5558 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:10.214437  5558 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea4044e955584568a7a78d191803537e, State: Initialized, Role: FOLLOWER
I20260928 13:03:10.214570  5558 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } }
I20260928 13:03:10.214643  5558 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:10.214674  5558 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:10.214713  5558 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:10.215636  5558 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } }
I20260928 13:03:10.215765  5558 leader_election.cc:302] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea4044e955584568a7a78d191803537e; no voters: 
I20260928 13:03:10.215987  5558 leader_election.cc:288] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:10.216046  5563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:10.216207  5563 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [term 1 LEADER]: Becoming Leader. State: Replica: ea4044e955584568a7a78d191803537e, State: Running, Role: LEADER
I20260928 13:03:10.216326  5558 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:10.216327  5563 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } }
I20260928 13:03:10.216730  5565 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea4044e955584568a7a78d191803537e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } } }
I20260928 13:03:10.216714  5563 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea4044e955584568a7a78d191803537e. Latest consensus state: current_term: 1 leader_uuid: "ea4044e955584568a7a78d191803537e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea4044e955584568a7a78d191803537e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37225 } } }
I20260928 13:03:10.216980  5563 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:10.217171  5565 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e [sys.catalog]: This master's current role is: LEADER
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:10.217764  5572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:10.218586  5572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:10.220443  5572 catalog_manager.cc:1347] Generated new cluster ID: e96428a07f3c4233bd0abfb193ad27cd
I20260928 13:03:10.220491  5572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:10.222554  5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.210275 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56552 (local address 127.3.6.62:37225)
0928 13:03:10.210460 (+   185us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:10.210468 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:10.210494 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:03:10.211090 (+   596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:10.211099 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:10.211164 (+    65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:10.211301 (+   137us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:10.211966 (+   665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.213418 (+  1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.214313 (+   895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.214963 (+   650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.215142 (+   179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.218201 (+  3059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:10.218205 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:10.218205 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:10.218219 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:10.220421 (+  2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.220928 (+   507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.220930 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.220931 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.221029 (+    98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.221210 (+   181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.221211 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.221211 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.221525 (+   314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:10.221679 (+   154us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:10.222198 (+   519us) server_negotiation.cc:299] Negotiation successful
0928 13:03:10.222334 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260928 13:03:10.224664  5572 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:10.225379  5572 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:10.229681  5572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea4044e955584568a7a78d191803537e: Generated new TSK 0
I20260928 13:03:10.229887  5572 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:10.260584  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:10.344439  5584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:10.344732  5584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:10.344792  5584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:10.346071  5584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:10.346143  5584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:10.346192  5584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:10.347823  5584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:10.348104  5584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:10.348347  5584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:10.354230  5592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.354269  5590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.354233  5589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:10.354450  5584 server_base.cc:1034] running on GCE node
I20260928 13:03:10.354780  5584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:10.355062  5584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:10.356235  5584 hybrid_clock.cc:648] HybridClock initialized: now 1790600590356216 us; error 30 us; skew 500 ppm
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:10.359117  5584 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:10.359654  5584 webserver.cc:460] Webserver started at http://127.3.6.1:35127/ using document root <none> and password file <none>
I20260928 13:03:10.359901  5584 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:10.359970  5584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:10.360111  5584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:10.361191  5584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "08d4eeb744364626a0f431934fb26ea1"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "21ed9458cac33728dc5740d5cdc90a4d"
server_key_iv: "a490a1119c6fd63a1bd0d10af2b3192f"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.361588  5584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "08d4eeb744364626a0f431934fb26ea1"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "21ed9458cac33728dc5740d5cdc90a4d"
server_key_iv: "a490a1119c6fd63a1bd0d10af2b3192f"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.362967  5584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:10.363854  5599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.364068  5584 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:10.364188  5584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "08d4eeb744364626a0f431934fb26ea1"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "21ed9458cac33728dc5740d5cdc90a4d"
server_key_iv: "a490a1119c6fd63a1bd0d10af2b3192f"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.364274  5584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:10.373868  5584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:10.376579  5584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:10.376765  5584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:10.377035  5584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:10.377362  5584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:10.377414  5584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.377449  5584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:10.377476  5584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.383468  5584 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:39309
I20260928 13:03:10.383523  5712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:39309 every 8 connection(s)
I20260928 13:03:10.383873  5584 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:10.386255  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5584
I20260928 13:03:10.386368  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:10.386547  3096 external_mini_cluster.cc:1428] Setting key 0bc7be72e0e91d02f67d6affe7e32067
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:10.393959  5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.384588 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:34789 (local address 127.3.6.62:37225)
0928 13:03:10.384672 (+    84us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:10.384674 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:10.384863 (+   189us) server_negotiation.cc:407] Connection header received
0928 13:03:10.385368 (+   505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:10.385369 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:10.385380 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:10.385446 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:10.386377 (+   931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.387093 (+   716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.388162 (+  1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.388446 (+   284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.388504 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.391107 (+  2603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:10.391108 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:10.391109 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:10.391115 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:10.392517 (+  1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.393016 (+   499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.393016 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.393017 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.393067 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.393341 (+   274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.393341 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.393342 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.393438 (+    96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:10.393488 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:10.393830 (+   342us) server_negotiation.cc:299] Negotiation successful
0928 13:03:10.393897 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 13:03:10.394259  5715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.384549 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37225 (local address 127.3.6.1:34789)
0928 13:03:10.384735 (+   186us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:10.384775 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:10.385224 (+   449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:10.385497 (+   273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:10.385501 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:10.386060 (+   559us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:10.386276 (+   216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.386280 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.387183 (+   903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.387184 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.388043 (+   859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.388045 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.388519 (+   474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.388531 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.388683 (+   152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.389228 (+   545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:10.389239 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:10.390982 (+  1743us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:10.392603 (+  1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.392609 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.392612 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.392931 (+   319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.393132 (+   201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.393133 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.393133 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.393273 (+   140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.393503 (+   230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:10.393509 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:10.393678 (+   169us) client_negotiation.cc:769] Sending connection context
0928 13:03:10.393808 (+   130us) client_negotiation.cc:240] Negotiation successful
0928 13:03:10.393986 (+   178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:03:10.394755  5713 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37225
I20260928 13:03:10.394850  5713 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:10.395073  5713 heartbeater.cc:511] Master 127.3.6.62:37225 requested a full tablet report, sending...
I20260928 13:03:10.395792  5522 ts_manager.cc:194] Registered new tserver with Master: 08d4eeb744364626a0f431934fb26ea1 (127.3.6.1:39309)
I20260928 13:03:10.396422  5522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:34789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:10.414115  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:10.499785  5718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:10.499993  5718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:10.500016  5718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:10.501159  5718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:10.501194  5718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:10.501219  5718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:10.502597  5718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:10.502786  5718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:10.502965  5718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:10.508301  5726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.508340  5723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.508294  5724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:10.508602  5718 server_base.cc:1034] running on GCE node
I20260928 13:03:10.508834  5718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:10.509089  5718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:10.510251  5718 hybrid_clock.cc:648] HybridClock initialized: now 1790600590510226 us; error 37 us; skew 500 ppm
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:10.512993  5718 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:10.513447  5718 webserver.cc:460] Webserver started at http://127.3.6.2:36577/ using document root <none> and password file <none>
I20260928 13:03:10.513720  5718 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:10.513767  5718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:10.513940  5718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:10.515079  5718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "0710cfdd8ae24d9aac6633d2b2a7cbbb"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "9a1389045f45513be6ff513530b8804d"
server_key_iv: "62cfcc03516d96b122a05758918009b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.515451  5718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "0710cfdd8ae24d9aac6633d2b2a7cbbb"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "9a1389045f45513be6ff513530b8804d"
server_key_iv: "62cfcc03516d96b122a05758918009b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.516875  5718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:10.517771  5733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.517944  5718 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:10.518050  5718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "0710cfdd8ae24d9aac6633d2b2a7cbbb"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "9a1389045f45513be6ff513530b8804d"
server_key_iv: "62cfcc03516d96b122a05758918009b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.518131  5718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:10.563462  5718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:10.565912  5718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:10.566076  5718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:10.566327  5718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:10.566655  5718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:10.566710  5718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.566753  5718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:10.566778  5718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.572947  5718 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:45161
I20260928 13:03:10.572979  5846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:45161 every 8 connection(s)
I20260928 13:03:10.573408  5718 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:10.579761  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5718
I20260928 13:03:10.579875  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:10.580044  3096 external_mini_cluster.cc:1428] Setting key b039a32e756f7b11ccd57b1f1a92aa67
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:10.583976  5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.574223 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:59739 (local address 127.3.6.62:37225)
0928 13:03:10.574297 (+    74us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:10.574299 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:10.574573 (+   274us) server_negotiation.cc:407] Connection header received
0928 13:03:10.575164 (+   591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:10.575166 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:10.575178 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:10.575250 (+    72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:10.576298 (+  1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.576828 (+   530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.577867 (+  1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.578060 (+   193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.578154 (+    94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.580716 (+  2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:10.580717 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:10.580718 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:10.580725 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:10.582499 (+  1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.582924 (+   425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.582925 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.582925 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.582984 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.583339 (+   355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.583340 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.583340 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.583441 (+   101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:10.583493 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:10.583850 (+   357us) server_negotiation.cc:299] Negotiation successful
0928 13:03:10.583915 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:10.584285  5849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.574222 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37225 (local address 127.3.6.2:59739)
0928 13:03:10.574427 (+   205us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:10.574465 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:10.575004 (+   539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:10.575325 (+   321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:10.575329 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:10.575970 (+   641us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:10.576195 (+   225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.576199 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.576925 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.576926 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.577760 (+   834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.577763 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.578152 (+   389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.578164 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.578303 (+   139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.578872 (+   569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:10.578881 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:10.580580 (+  1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:10.582587 (+  2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.582626 (+    39us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.582628 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.582840 (+   212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.583114 (+   274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.583115 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.583115 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.583260 (+   145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.583508 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:10.583514 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:10.583708 (+   194us) client_negotiation.cc:769] Sending connection context
0928 13:03:10.583822 (+   114us) client_negotiation.cc:240] Negotiation successful
0928 13:03:10.584005 (+   183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":88,"threads_started":1}
I20260928 13:03:10.584829  5847 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37225
I20260928 13:03:10.584930  5847 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:10.585112  5847 heartbeater.cc:511] Master 127.3.6.62:37225 requested a full tablet report, sending...
I20260928 13:03:10.585541  5522 ts_manager.cc:194] Registered new tserver with Master: 0710cfdd8ae24d9aac6633d2b2a7cbbb (127.3.6.2:45161)
I20260928 13:03:10.586035  5522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:59739
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:10.607626  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:10.689929  5852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:10.690230  5852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:10.690276  5852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:10.691591  5852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:10.691694  5852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:10.691740  5852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:10.693396  5852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37225
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:10.693763  5852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:10.694029  5852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:10.699317  5858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.699317  5860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:10.699339  5857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:10.699797  5852 server_base.cc:1034] running on GCE node
I20260928 13:03:10.700027  5852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:10.700289  5852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:10.701475  5852 hybrid_clock.cc:648] HybridClock initialized: now 1790600590701456 us; error 31 us; skew 500 ppm
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:10.704521  5852 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:10.704924  5852 webserver.cc:460] Webserver started at http://127.3.6.3:44147/ using document root <none> and password file <none>
I20260928 13:03:10.705113  5852 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:10.705153  5852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:10.705241  5852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:10.706315  5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "a5bf20f4d2874954a2e8ad462db68b0e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "1281dec2fad3997bb1d2c35271dd59b6"
server_key_iv: "d3397b3ad87d8d0db1d0660d7b17e2a4"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.706624  5852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "a5bf20f4d2874954a2e8ad462db68b0e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "1281dec2fad3997bb1d2c35271dd59b6"
server_key_iv: "d3397b3ad87d8d0db1d0660d7b17e2a4"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.708058  5852 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:10.708766  5867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.708979  5852 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:10.709064  5852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "a5bf20f4d2874954a2e8ad462db68b0e"
format_stamp: "Formatted at 2026-09-28 13:03:10 on dist-test-slave-ddvw"
server_key: "1281dec2fad3997bb1d2c35271dd59b6"
server_key_iv: "d3397b3ad87d8d0db1d0660d7b17e2a4"
server_key_version: "encryptionkey@0"
I20260928 13:03:10.709120  5852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:10.737293  5852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:10.739356  5852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:10.739472  5852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:10.739672  5852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:10.739919  5852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:10.739948  5852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.739969  5852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:10.739982  5852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:10.745785  5852 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:34813
I20260928 13:03:10.745882  5980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:34813 every 8 connection(s)
I20260928 13:03:10.746192  5852 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5477](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600590, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:10.752857  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 5852
I20260928 13:03:10.752971  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:10.753153  3096 external_mini_cluster.cc:1428] Setting key 38abf4e8d0f9b3519bf8e9785bf7739c
I20260928 13:03:10.755891  5561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.746979 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:38763 (local address 127.3.6.62:37225)
0928 13:03:10.747096 (+   117us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:10.747098 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:10.747254 (+   156us) server_negotiation.cc:407] Connection header received
0928 13:03:10.747774 (+   520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:10.747776 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:10.747786 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:10.747853 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:10.748809 (+   956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.749324 (+   515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.750408 (+  1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.750611 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.750678 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.752778 (+  2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:10.752779 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:10.752780 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:10.752788 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:10.754491 (+  1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.754889 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.754890 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.754890 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.754950 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:10.755233 (+   283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:10.755234 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:10.755234 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:10.755348 (+   114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:10.755404 (+    56us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:10.755750 (+   346us) server_negotiation.cc:299] Negotiation successful
0928 13:03:10.755825 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260928 13:03:10.756021  5983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:10.746946 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37225 (local address 127.3.6.3:38763)
0928 13:03:10.747120 (+   174us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:10.747163 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:10.747654 (+   491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:10.747935 (+   281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:10.747938 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:10.748511 (+   573us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:10.748706 (+   195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.748710 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.749408 (+   698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.749409 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.750316 (+   907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:10.750319 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:10.750681 (+   362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:10.750690 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:10.750786 (+    96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:10.751302 (+   516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:10.751310 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:10.752670 (+  1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:10.754570 (+  1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.754577 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.754579 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.754809 (+   230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.755059 (+   250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:10.755060 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:10.755060 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:10.755172 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:10.755406 (+   234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:10.755411 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:10.755609 (+   198us) client_negotiation.cc:769] Sending connection context
0928 13:03:10.755694 (+    85us) client_negotiation.cc:240] Negotiation successful
0928 13:03:10.755825 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":102,"threads_started":1}
I20260928 13:03:10.756508  5981 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37225
I20260928 13:03:10.756601  5981 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:10.756749  5981 heartbeater.cc:511] Master 127.3.6.62:37225 requested a full tablet report, sending...
I20260928 13:03:10.757105  5522 ts_manager.cc:194] Registered new tserver with Master: a5bf20f4d2874954a2e8ad462db68b0e (127.3.6.3:34813)
I20260928 13:03:10.757485  5522 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:38763
I20260928 13:03:10.765316  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 13:03:10.777132  5561 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:10.776120 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56554 (local address 127.3.6.62:37225)
0928 13:03:10.776205 (+    85us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:10.776207 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:10.776293 (+    86us) server_negotiation.cc:407] Connection header received
0928 13:03:10.776362 (+    69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:10.776362 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:10.776372 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:10.776441 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:10.777040 (+   599us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56554: BlockingRecv error: recv got EOF from 127.0.0.1:56554 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 13:03:10.778024  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5584
I20260928 13:03:10.782413  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5718
I20260928 13:03:10.786928  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5852
I20260928 13:03:10.792760  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 5490
2026-09-28T13:03:10Z chronyd exiting
[       OK ] SecurityITest.TestNoKerberosCredentials (1906 ms)
[ RUN      ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5993](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5993](info): set up 2 sockets
Sep 28 13:03:10 dist-test-slave-ddvw krb5kdc[5993](info): commencing operation
krb5kdc: starting...
W20260928 13:03:11.835417  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.022s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:11 dist-test-slave-ddvw krb5kdc[5993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:11.954604  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35739
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:42497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:35739
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:12.035470  6006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:12.035689  6006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:12.035712  6006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:12.036942  6006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:12.036988  6006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:12.037002  6006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:12.037057  6006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:12.037083  6006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:12.038630  6006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:35739
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:12.038899  6006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:12.039158  6006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:12.044135  6011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:12.044122  6012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:12.044126  6014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:12.044517  6006 server_base.cc:1034] running on GCE node
I20260928 13:03:12.044782  6006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:12.045110  6006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:12.046306  6006 hybrid_clock.cc:648] HybridClock initialized: now 1790600592046287 us; error 45 us; skew 500 ppm
Sep 28 13:03:12 dist-test-slave-ddvw krb5kdc[5993](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600592, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:12.054296  6006 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:12.055079  6006 webserver.cc:460] Webserver started at http://127.3.6.62:36613/ using document root <none> and password file <none>
I20260928 13:03:12.055418  6006 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:12.055495  6006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:12.055676  6006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:12.057363  6006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "0949a98232e848ad80fcea57238f20d8"
format_stamp: "Formatted at 2026-09-28 13:03:12 on dist-test-slave-ddvw"
server_key: "d6a7ad4f7cbad48c5712424ffcf0a9e2"
server_key_iv: "200eb39bd0b1e31f18a348e27291a696"
server_key_version: "encryptionkey@0"
I20260928 13:03:12.057837  6006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "0949a98232e848ad80fcea57238f20d8"
format_stamp: "Formatted at 2026-09-28 13:03:12 on dist-test-slave-ddvw"
server_key: "d6a7ad4f7cbad48c5712424ffcf0a9e2"
server_key_iv: "200eb39bd0b1e31f18a348e27291a696"
server_key_version: "encryptionkey@0"
I20260928 13:03:12.059841  6006 fs_manager.cc:691] Time spent creating directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260928 13:03:12.060884  6021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:12.061107  6006 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:12.061187  6006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "0949a98232e848ad80fcea57238f20d8"
format_stamp: "Formatted at 2026-09-28 13:03:12 on dist-test-slave-ddvw"
server_key: "d6a7ad4f7cbad48c5712424ffcf0a9e2"
server_key_iv: "200eb39bd0b1e31f18a348e27291a696"
server_key_version: "encryptionkey@0"
I20260928 13:03:12.061251  6006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:12.079816  6006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:12.081977  6006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:12.082103  6006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:12.086315  6006 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:35739
I20260928 13:03:12.086350  6073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:35739 every 8 connection(s)
I20260928 13:03:12.086755  6006 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:12.087821  6074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:12.089839  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6006
I20260928 13:03:12.089948  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:12.090118  3096 external_mini_cluster.cc:1428] Setting key fc8d87655690fea67d386865d6da83c8
I20260928 13:03:12.090950  6074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8: Bootstrap starting.
I20260928 13:03:12.091768  6074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:12.092175  6074 log.cc:824] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:12.093089  6074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8: No bootstrap required, opened a new log
I20260928 13:03:12.095172  6074 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } }
I20260928 13:03:12.095366  6074 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:12.095419  6074 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0949a98232e848ad80fcea57238f20d8, State: Initialized, Role: FOLLOWER
I20260928 13:03:12.095566  6074 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } }
I20260928 13:03:12.095685  6074 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:12.095721  6074 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:12.095782  6074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:12.096509  6074 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } }
I20260928 13:03:12.096613  6074 leader_election.cc:302] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0949a98232e848ad80fcea57238f20d8; no voters: 
I20260928 13:03:12.096828  6074 leader_election.cc:288] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:12.096908  6079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:12.097136  6079 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [term 1 LEADER]: Becoming Leader. State: Replica: 0949a98232e848ad80fcea57238f20d8, State: Running, Role: LEADER
I20260928 13:03:12.097159  6074 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:12.097286  6079 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } }
I20260928 13:03:12.097749  6079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0949a98232e848ad80fcea57238f20d8. Latest consensus state: current_term: 1 leader_uuid: "0949a98232e848ad80fcea57238f20d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } } }
I20260928 13:03:12.097759  6080 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0949a98232e848ad80fcea57238f20d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0949a98232e848ad80fcea57238f20d8" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35739 } } }
I20260928 13:03:12.097946  6079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [sys.catalog]: This master's current role is: LEADER
Sep 28 13:03:12 dist-test-slave-ddvw krb5kdc[5993](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:12.097957  6080 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:12.098218  6088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:12.098822  6088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:12.101989  6088 catalog_manager.cc:1347] Generated new cluster ID: 61f98874538442a2bad42675e266b3ba
I20260928 13:03:12.102052  6088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:12.103150  6077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:12.090705 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43480 (local address 127.3.6.62:35739)
0928 13:03:12.090901 (+   196us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:12.090910 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:12.090937 (+    27us) server_negotiation.cc:407] Connection header received
0928 13:03:12.091441 (+   504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:12.091449 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:12.091513 (+    64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:12.091650 (+   137us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:12.092615 (+   965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:12.093695 (+  1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:12.094581 (+   886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:12.095141 (+   560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:12.095304 (+   163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:12.098794 (+  3490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:12.098800 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:12.098800 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:12.098814 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:12.101251 (+  2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:12.101812 (+   561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:12.101815 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:12.101816 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:12.101941 (+   125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:12.102146 (+   205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:12.102147 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:12.102148 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:12.102423 (+   275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:12.102603 (+   180us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:12.102723 (+   120us) server_negotiation.cc:299] Negotiation successful
0928 13:03:12.102878 (+   155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":104,"threads_started":1}
I20260928 13:03:12.104101  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:03:12.117985  6088 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:12.118846  6088 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:12.120903  6077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:12.116307 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43484 (local address 127.3.6.62:35739)
0928 13:03:12.116365 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:12.116367 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:12.116514 (+   147us) server_negotiation.cc:407] Connection header received
0928 13:03:12.116624 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:12.116625 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:12.116638 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:12.116671 (+    33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:12.117225 (+   554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:12.117870 (+   645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:12.119093 (+  1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:12.119437 (+   344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:12.119479 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:12.120361 (+   882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:12.120362 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:12.120363 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:12.120595 (+   232us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:12.120613 (+    18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:12.120620 (+     7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:12.120651 (+    31us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:12.120774 (+   123us) server_negotiation.cc:299] Negotiation successful
0928 13:03:12.120817 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:12.130101  6088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0949a98232e848ad80fcea57238f20d8: Generated new TSK 0
I20260928 13:03:12.130363  6088 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:12.134205  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6006
2026-09-28T13:03:12Z chronyd exiting
[       OK ] SecurityITest.SaslPlainFallback (1338 ms)
[ RUN      ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:12 dist-test-slave-ddvw krb5kdc[6107](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:12 dist-test-slave-ddvw krb5kdc[6107](info): set up 2 sockets
Sep 28 13:03:12 dist-test-slave-ddvw krb5kdc[6107](info): commencing operation
krb5kdc: starting...
W20260928 13:03:13.159228  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.007s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:13.277702  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36439
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36439
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:13.359661  6120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:13.359943  6120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:13.359984  6120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:13.361280  6120 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:13.361366  6120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:13.361392  6120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:13.361414  6120 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:13.361454  6120 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:13.363143  6120 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36439
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:13.363457  6120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:13.363698  6120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:13.368788  6126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.368786  6128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.368781  6125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:13.369239  6120 server_base.cc:1034] running on GCE node
I20260928 13:03:13.369488  6120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:13.369762  6120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:13.370916  6120 hybrid_clock.cc:648] HybridClock initialized: now 1790600593370905 us; error 35 us; skew 500 ppm
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:13.373517  6120 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:13.373960  6120 webserver.cc:460] Webserver started at http://127.3.6.62:37771/ using document root <none> and password file <none>
I20260928 13:03:13.374166  6120 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:13.374218  6120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:13.374315  6120 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:13.375492  6120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "aa9564d778064d9785367ceb7b4e1c24"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "121c0729cf651861f100aee052244848"
server_key_iv: "6b99f04ea2e68806d66a0d44ffe16946"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.375830  6120 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "aa9564d778064d9785367ceb7b4e1c24"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "121c0729cf651861f100aee052244848"
server_key_iv: "6b99f04ea2e68806d66a0d44ffe16946"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.377236  6120 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:13.378003  6135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.378260  6120 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:13.378391  6120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "aa9564d778064d9785367ceb7b4e1c24"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "121c0729cf651861f100aee052244848"
server_key_iv: "6b99f04ea2e68806d66a0d44ffe16946"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.378477  6120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:13.397588  6120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:13.400198  6120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:13.400372  6120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:13.404610  6120 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36439
I20260928 13:03:13.404645  6187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36439 every 8 connection(s)
I20260928 13:03:13.405052  6120 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:13.406055  6188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:13.408269  6188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24: Bootstrap starting.
I20260928 13:03:13.408816  6188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:13.409050  6188 log.cc:824] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:13.409686  6188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24: No bootstrap required, opened a new log
I20260928 13:03:13.411327  6188 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } }
I20260928 13:03:13.411466  6188 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:13.411489  6188 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa9564d778064d9785367ceb7b4e1c24, State: Initialized, Role: FOLLOWER
I20260928 13:03:13.411630  6188 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } }
I20260928 13:03:13.411715  6188 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:13.411738  6188 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:13.411779  6188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:13.412539  6188 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } }
I20260928 13:03:13.412628  6188 leader_election.cc:302] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa9564d778064d9785367ceb7b4e1c24; no voters: 
I20260928 13:03:13.412756  6188 leader_election.cc:288] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:13.412804  6191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:13.413017  6191 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [term 1 LEADER]: Becoming Leader. State: Replica: aa9564d778064d9785367ceb7b4e1c24, State: Running, Role: LEADER
I20260928 13:03:13.413057  6188 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:13.413113  6191 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } }
I20260928 13:03:13.413177  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6120
I20260928 13:03:13.413300  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:13.413489  3096 external_mini_cluster.cc:1428] Setting key 38362d03e54f324bdb2a84ca780e6262
I20260928 13:03:13.413442  6191 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa9564d778064d9785367ceb7b4e1c24. Latest consensus state: current_term: 1 leader_uuid: "aa9564d778064d9785367ceb7b4e1c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } } }
I20260928 13:03:13.413452  6192 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa9564d778064d9785367ceb7b4e1c24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa9564d778064d9785367ceb7b4e1c24" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36439 } } }
I20260928 13:03:13.413527  6192 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:13.413525  6191 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:13.413902  6197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:13.414481  6197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:13.417116  6197 catalog_manager.cc:1347] Generated new cluster ID: 73fb66ab89d2476bbeb48259dae2aed6
I20260928 13:03:13.417274  6197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:13.426687  6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.414175 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55696 (local address 127.3.6.62:36439)
0928 13:03:13.415173 (+   998us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:13.415184 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:13.415223 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:13.415364 (+   141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:13.415372 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:13.415432 (+    60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:13.415601 (+   169us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:13.416398 (+   797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.417946 (+  1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.419138 (+  1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.419799 (+   661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.419933 (+   134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.422881 (+  2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:13.422886 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:13.422886 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:13.422899 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:13.424936 (+  2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.425399 (+   463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.425402 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.425402 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.425507 (+   105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.425720 (+   213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.425720 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.425720 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.426036 (+   316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:13.426174 (+   138us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:13.426323 (+   149us) server_negotiation.cc:299] Negotiation successful
0928 13:03:13.426459 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":931,"thread_start_us":84,"threads_started":1}
I20260928 13:03:13.428045  6197 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:13.428675  6197 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:13.432688  6197 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa9564d778064d9785367ceb7b4e1c24: Generated new TSK 0
I20260928 13:03:13.432868  6197 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:13.457468  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:13.539568  6214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:13.539780  6214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:13.539806  6214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:13.541018  6214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:13.541062  6214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:13.541091  6214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:13.542637  6214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:13.542889  6214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:13.543186  6214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:13.548185  6220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.548209  6219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:13.548388  6214 server_base.cc:1034] running on GCE node
W20260928 13:03:13.548209  6222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:13.548731  6214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:13.548996  6214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:13.550160  6214 hybrid_clock.cc:648] HybridClock initialized: now 1790600593550164 us; error 43 us; skew 500 ppm
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:13.552888  6214 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:13.553323  6214 webserver.cc:460] Webserver started at http://127.3.6.1:38165/ using document root <none> and password file <none>
I20260928 13:03:13.553526  6214 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:13.553566  6214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:13.553665  6214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:13.554698  6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "eefb2d6f66a842fabfe20c9b84f7c06a"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "022232d4710a5dcc6cb7b8cf2e5e6d56"
server_key_iv: "9844d1e7ad832a4e6ade457475ca6d52"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.554994  6214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "eefb2d6f66a842fabfe20c9b84f7c06a"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "022232d4710a5dcc6cb7b8cf2e5e6d56"
server_key_iv: "9844d1e7ad832a4e6ade457475ca6d52"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.556367  6214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:13.557133  6229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.557349  6214 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:13.557420  6214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "eefb2d6f66a842fabfe20c9b84f7c06a"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "022232d4710a5dcc6cb7b8cf2e5e6d56"
server_key_iv: "9844d1e7ad832a4e6ade457475ca6d52"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.557512  6214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:13.577592  6214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:13.580214  6214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:13.580377  6214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:13.580644  6214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:13.581003  6214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:13.581063  6214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.581101  6214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:13.581132  6214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.587260  6214 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:39573
I20260928 13:03:13.587299  6342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:39573 every 8 connection(s)
I20260928 13:03:13.587683  6214 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:13.592746  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6214
I20260928 13:03:13.592864  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:13.593101  3096 external_mini_cluster.cc:1428] Setting key 280818fe5b2077e6469d92e50474477c
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:13.598369  6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.588546 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50841 (local address 127.3.6.62:36439)
0928 13:03:13.588621 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:13.588624 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:13.588863 (+   239us) server_negotiation.cc:407] Connection header received
0928 13:03:13.589359 (+   496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:13.589360 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:13.589372 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:13.589427 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:13.590385 (+   958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.590877 (+   492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.591962 (+  1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.592176 (+   214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.592233 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.595046 (+  2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:13.595048 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:13.595048 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:13.595060 (+    12us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:13.596903 (+  1843us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.597298 (+   395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.597300 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.597300 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.597364 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.597630 (+   266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.597631 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.597631 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.597800 (+   169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:13.597876 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:13.598129 (+   253us) server_negotiation.cc:299] Negotiation successful
0928 13:03:13.598226 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:03:13.598384  6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.588514 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36439 (local address 127.3.6.1:50841)
0928 13:03:13.588717 (+   203us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:13.588765 (+    48us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:13.589274 (+   509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:13.589511 (+   237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:13.589515 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:13.590089 (+   574us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:13.590303 (+   214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.590308 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.590957 (+   649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.590957 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.591866 (+   909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.591868 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.592248 (+   380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.592259 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.592365 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.593036 (+   671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:13.593047 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:13.594931 (+  1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:13.596980 (+  2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.596985 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.596987 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.597220 (+   233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.597432 (+   212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.597433 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.597433 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.597548 (+   115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.597871 (+   323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:13.597876 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:13.597998 (+   122us) client_negotiation.cc:769] Sending connection context
0928 13:03:13.598083 (+    85us) client_negotiation.cc:240] Negotiation successful
0928 13:03:13.598222 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":111,"threads_started":1}
I20260928 13:03:13.598975  6343 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36439
I20260928 13:03:13.599125  6343 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:13.599308  6343 heartbeater.cc:511] Master 127.3.6.62:36439 requested a full tablet report, sending...
I20260928 13:03:13.599849  6152 ts_manager.cc:194] Registered new tserver with Master: eefb2d6f66a842fabfe20c9b84f7c06a (127.3.6.1:39573)
I20260928 13:03:13.600482  6152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:50841
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:13.621628  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:13.703660  6348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:13.703912  6348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:13.703951  6348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:13.705367  6348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:13.705431  6348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:13.705475  6348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:13.706950  6348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:13.707261  6348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:13.707504  6348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:13.712796  6348 server_base.cc:1034] running on GCE node
W20260928 13:03:13.712774  6356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.712775  6354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.712829  6353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:13.713219  6348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:13.713516  6348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:13.714720  6348 hybrid_clock.cc:648] HybridClock initialized: now 1790600593714715 us; error 36 us; skew 500 ppm
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:13.717495  6348 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:13.717960  6348 webserver.cc:460] Webserver started at http://127.3.6.2:42999/ using document root <none> and password file <none>
I20260928 13:03:13.718211  6348 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:13.718282  6348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:13.718432  6348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:13.719589  6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "c10769ab81664fc8934125fa72216427"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "fedb4cd26dde8ba41b33aed5c2ef18ed"
server_key_iv: "357ecbaca9acb26a4871b1866a58a838"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.719955  6348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "c10769ab81664fc8934125fa72216427"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "fedb4cd26dde8ba41b33aed5c2ef18ed"
server_key_iv: "357ecbaca9acb26a4871b1866a58a838"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.721277  6348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.001s
I20260928 13:03:13.722035  6363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.722239  6348 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:13.722345  6348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "c10769ab81664fc8934125fa72216427"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "fedb4cd26dde8ba41b33aed5c2ef18ed"
server_key_iv: "357ecbaca9acb26a4871b1866a58a838"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.722424  6348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:13.737257  6348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:13.739949  6348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:13.740144  6348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:13.740398  6348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:13.740733  6348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:13.740790  6348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.740831  6348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:13.740859  6348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.746688  6348 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:43705
I20260928 13:03:13.746745  6476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:43705 every 8 connection(s)
I20260928 13:03:13.747131  6348 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:13.756665  6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.747933 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:51295 (local address 127.3.6.62:36439)
0928 13:03:13.747979 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:13.747981 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:13.748201 (+   220us) server_negotiation.cc:407] Connection header received
0928 13:03:13.748677 (+   476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:13.748678 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:13.748688 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:13.748744 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:13.749640 (+   896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.750143 (+   503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.751228 (+  1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.751485 (+   257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.751545 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.753693 (+  2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:13.753694 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:13.753695 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:13.753702 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:13.754987 (+  1285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.755443 (+   456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.755445 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.755445 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.755566 (+   121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.755933 (+   367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.755934 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.755935 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.756131 (+   196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:13.756207 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:13.756521 (+   314us) server_negotiation.cc:299] Negotiation successful
0928 13:03:13.756591 (+    70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:13.756840  6479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.747909 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36439 (local address 127.3.6.2:51295)
0928 13:03:13.748049 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:13.748094 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:13.748580 (+   486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:13.748801 (+   221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:13.748804 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:13.749364 (+   560us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:13.749554 (+   190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.749558 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.750248 (+   690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.750249 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.751149 (+   900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.751151 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.751553 (+   402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.751562 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.751678 (+   116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.752162 (+   484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:13.752171 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:13.753571 (+  1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:13.755126 (+  1555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.755133 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.755135 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.755360 (+   225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.755762 (+   402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.755763 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.755763 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.755862 (+    99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.756226 (+   364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:13.756233 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:13.756389 (+   156us) client_negotiation.cc:769] Sending connection context
0928 13:03:13.756495 (+   106us) client_negotiation.cc:240] Negotiation successful
0928 13:03:13.756620 (+   125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":76,"threads_started":1}
I20260928 13:03:13.756871  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6348
I20260928 13:03:13.756961  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:13.757193  3096 external_mini_cluster.cc:1428] Setting key d4f166f847f4a18e311984ffe8c532c7
I20260928 13:03:13.757356  6477 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36439
I20260928 13:03:13.757464  6477 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:13.757699  6477 heartbeater.cc:511] Master 127.3.6.62:36439 requested a full tablet report, sending...
I20260928 13:03:13.758121  6152 ts_manager.cc:194] Registered new tserver with Master: c10769ab81664fc8934125fa72216427 (127.3.6.2:43705)
I20260928 13:03:13.758618  6152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:51295
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:13.782300  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:13.865943  6482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:13.866219  6482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:13.866263  6482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:13.867623  6482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:13.867699  6482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:13.867761  6482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:13.869314  6482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:13.869617  6482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:13.869879  6482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:13.875209  6482 server_base.cc:1034] running on GCE node
W20260928 13:03:13.875182  6488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.875182  6490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:13.875174  6487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:13.875591  6482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:13.875882  6482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:13.877029  6482 hybrid_clock.cc:648] HybridClock initialized: now 1790600593877016 us; error 27 us; skew 500 ppm
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:13.879637  6482 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:13.880075  6482 webserver.cc:460] Webserver started at http://127.3.6.3:40345/ using document root <none> and password file <none>
I20260928 13:03:13.880316  6482 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:13.880386  6482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:13.880534  6482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:13.881654  6482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "92441743ce564212af2d80ec53ce3bbd"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "687fef44fa48de375b4d3ad699907d48"
server_key_iv: "d0723b433379898f2aa79afc706aef49"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.882010  6482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "92441743ce564212af2d80ec53ce3bbd"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "687fef44fa48de375b4d3ad699907d48"
server_key_iv: "d0723b433379898f2aa79afc706aef49"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.883427  6482 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:13.884189  6497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.884374  6482 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:13.884469  6482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "92441743ce564212af2d80ec53ce3bbd"
format_stamp: "Formatted at 2026-09-28 13:03:13 on dist-test-slave-ddvw"
server_key: "687fef44fa48de375b4d3ad699907d48"
server_key_iv: "d0723b433379898f2aa79afc706aef49"
server_key_version: "encryptionkey@0"
I20260928 13:03:13.884546  6482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:13.912406  6482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:13.914765  6482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:13.914920  6482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:13.915198  6482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:13.915520  6482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:13.915575  6482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.915618  6482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:13.915645  6482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:13.921634  6482 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:41405
I20260928 13:03:13.921675  6610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:41405 every 8 connection(s)
I20260928 13:03:13.922017  6482 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:13.927426  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6482
I20260928 13:03:13.927527  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:13.927736  3096 external_mini_cluster.cc:1428] Setting key 4255c56ed062f41d716710fcb3ba5762
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:13.931790  6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.922733 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:45129 (local address 127.3.6.62:36439)
0928 13:03:13.922804 (+    71us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:13.922806 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:13.923073 (+   267us) server_negotiation.cc:407] Connection header received
0928 13:03:13.923620 (+   547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:13.923621 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:13.923631 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:13.923686 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:13.924623 (+   937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.925116 (+   493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.926147 (+  1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.926411 (+   264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.926465 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.928909 (+  2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:13.928910 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:13.928910 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:13.928916 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:13.930368 (+  1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.930875 (+   507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.930876 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.930877 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.930929 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.931246 (+   317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.931246 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.931246 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.931356 (+   110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:13.931410 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:13.931660 (+   250us) server_negotiation.cc:299] Negotiation successful
0928 13:03:13.931726 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 13:03:13.931979  6613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.922756 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36439 (local address 127.3.6.3:45129)
0928 13:03:13.922922 (+   166us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:13.922958 (+    36us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:13.923531 (+   573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:13.923751 (+   220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:13.923755 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:13.924337 (+   582us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:13.924537 (+   200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.924541 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.925273 (+   732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.925274 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.926071 (+   797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:13.926073 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.926473 (+   400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.926482 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:13.926588 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.927213 (+   625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:13.927222 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:13.928833 (+  1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:13.930466 (+  1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.930472 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.930474 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.930791 (+   317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.931001 (+   210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:13.931002 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:13.931002 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:13.931177 (+   175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:13.931415 (+   238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:13.931419 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:13.931542 (+   123us) client_negotiation.cc:769] Sending connection context
0928 13:03:13.931621 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:03:13.931743 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":85,"threads_started":1}
I20260928 13:03:13.932425  6611 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36439
I20260928 13:03:13.932510  6611 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:13.932713  6611 heartbeater.cc:511] Master 127.3.6.62:36439 requested a full tablet report, sending...
I20260928 13:03:13.933063  6152 ts_manager.cc:194] Registered new tserver with Master: 92441743ce564212af2d80ec53ce3bbd (127.3.6.3:41405)
I20260928 13:03:13.933468  6152 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:45129
I20260928 13:03:13.939651  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM: 
Sep 28 13:03:13 dist-test-slave-ddvw krb5kdc[6107](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600593, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:13.962793  6205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:13.955532 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55712 (local address 127.3.6.62:36439)
0928 13:03:13.955627 (+    95us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:13.955629 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:13.955686 (+    57us) server_negotiation.cc:407] Connection header received
0928 13:03:13.955737 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:13.955738 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:13.955748 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:13.955799 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:13.956348 (+   549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.956830 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.957531 (+   701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:13.957723 (+   192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:13.957778 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:13.960154 (+  2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:13.960156 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:13.960156 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:13.960171 (+    15us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:13.961592 (+  1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.961975 (+   383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.961977 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.961977 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.962036 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:13.962234 (+   198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:13.962235 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:13.962236 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:13.962391 (+   155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:13.962494 (+   103us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:13.962602 (+   108us) server_negotiation.cc:299] Negotiation successful
0928 13:03:13.962686 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260928 13:03:13.963065  6152 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55712
I20260928 13:03:13.963523  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6214
I20260928 13:03:13.968653  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6348
I20260928 13:03:13.972995  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6482
I20260928 13:03:13.977532  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6120
2026-09-28T13:03:13Z chronyd exiting
[       OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1845 ms)
[ RUN      ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:14 dist-test-slave-ddvw krb5kdc[6623](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:14 dist-test-slave-ddvw krb5kdc[6623](info): set up 2 sockets
Sep 28 13:03:14 dist-test-slave-ddvw krb5kdc[6623](info): commencing operation
krb5kdc: starting...
W20260928 13:03:15.075433  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.078s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:15.195451  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36493
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36493
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:15.283721  6636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:15.284022  6636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:15.284065  6636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:15.285426  6636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:15.285509  6636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:15.285538  6636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:15.285573  6636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:15.285622  6636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:15.287431  6636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:15.287760  6636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:15.288028  6636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:15.293249  6644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.293428  6636 server_base.cc:1034] running on GCE node
W20260928 13:03:15.293268  6641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.293243  6642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.293800  6636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:15.294100  6636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:15.295243  6636 hybrid_clock.cc:648] HybridClock initialized: now 1790600595295217 us; error 48 us; skew 500 ppm
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:15.297909  6636 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:15.298334  6636 webserver.cc:460] Webserver started at http://127.3.6.62:38321/ using document root <none> and password file <none>
I20260928 13:03:15.298576  6636 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:15.298647  6636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:15.298813  6636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:15.299937  6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "2994868d11e042faa799c3deaa7c7ada"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "3d787e4bd169f228f4a5400884facc3c"
server_key_iv: "b628ee162fe38d7d0158b67acf55e10b"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.300341  6636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "2994868d11e042faa799c3deaa7c7ada"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "3d787e4bd169f228f4a5400884facc3c"
server_key_iv: "b628ee162fe38d7d0158b67acf55e10b"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.301633  6636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:15.302413  6651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.302580  6636 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:15.302721  6636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "2994868d11e042faa799c3deaa7c7ada"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "3d787e4bd169f228f4a5400884facc3c"
server_key_iv: "b628ee162fe38d7d0158b67acf55e10b"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.302806  6636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:15.334787  6636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:15.337438  6636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:15.337620  6636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:15.341769  6636 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36493
I20260928 13:03:15.341821  6703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36493 every 8 connection(s)
I20260928 13:03:15.342379  6636 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:15.343266  6704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:15.345484  6704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: Bootstrap starting.
I20260928 13:03:15.346029  6704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:15.346262  6704 log.cc:824] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:15.346961  6704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: No bootstrap required, opened a new log
I20260928 13:03:15.348546  6704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } }
I20260928 13:03:15.348681  6704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:15.348703  6704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2994868d11e042faa799c3deaa7c7ada, State: Initialized, Role: FOLLOWER
I20260928 13:03:15.348855  6704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } }
I20260928 13:03:15.348934  6704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:15.348963  6704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:15.348990  6704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:15.349829  6704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } }
I20260928 13:03:15.349911  6704 leader_election.cc:302] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2994868d11e042faa799c3deaa7c7ada; no voters: 
I20260928 13:03:15.350033  6704 leader_election.cc:288] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:15.350109  6707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:15.350296  6707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [term 1 LEADER]: Becoming Leader. State: Replica: 2994868d11e042faa799c3deaa7c7ada, State: Running, Role: LEADER
I20260928 13:03:15.350306  6704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:15.350472  6707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } }
I20260928 13:03:15.350883  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6636
I20260928 13:03:15.350986  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:15.350939  6709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2994868d11e042faa799c3deaa7c7ada. Latest consensus state: current_term: 1 leader_uuid: "2994868d11e042faa799c3deaa7c7ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } } }
I20260928 13:03:15.350968  6708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2994868d11e042faa799c3deaa7c7ada" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2994868d11e042faa799c3deaa7c7ada" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36493 } } }
I20260928 13:03:15.351053  6709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:15.351076  6708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:15.351212  3096 external_mini_cluster.cc:1428] Setting key 17525461fb43d802de8f6a22aed0e616
W20260928 13:03:15.352325  6723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:15.352427  6723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:15.352532  6716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:15.352741  6716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:15.354310  6716 catalog_manager.cc:1347] Generated new cluster ID: e06174a0a520419a902176c2eb163707
I20260928 13:03:15.354362  6716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:15.362725  6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.351672 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58454 (local address 127.3.6.62:36493)
0928 13:03:15.352074 (+   402us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.352082 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.352107 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:03:15.352204 (+    97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.352209 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.352256 (+    47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.352398 (+   142us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.353151 (+   753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.354394 (+  1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.355458 (+  1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.356119 (+   661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.356258 (+   139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.358872 (+  2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.358876 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.358876 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.358889 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.361076 (+  2187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.361467 (+   391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.361470 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.361470 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.361594 (+   124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.361803 (+   209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.361804 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.361805 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.362128 (+   323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.362286 (+   158us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.362361 (+    75us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.362500 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":74,"threads_started":1}
I20260928 13:03:15.379478  6716 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:15.380295  6716 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:15.386686  6716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2994868d11e042faa799c3deaa7c7ada: Generated new TSK 0
I20260928 13:03:15.386927  6716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:15.418347  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:15.500413  6730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:15.500610  6730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:15.500634  6730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:15.501796  6730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:15.501839  6730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:15.501865  6730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:15.503471  6730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:15.503711  6730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:15.503937  6730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:15.508977  6738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.509058  6735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.508977  6736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.509341  6730 server_base.cc:1034] running on GCE node
I20260928 13:03:15.509523  6730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:15.509750  6730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:15.510905  6730 hybrid_clock.cc:648] HybridClock initialized: now 1790600595510890 us; error 28 us; skew 500 ppm
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:15.513496  6730 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:15.513916  6730 webserver.cc:460] Webserver started at http://127.3.6.1:40983/ using document root <none> and password file <none>
I20260928 13:03:15.514137  6730 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:15.514202  6730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:15.514353  6730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:15.515511  6730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "b48114b9cbb547fcbffc3397875205a2"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "76fc73bc8de7a65068eb3be454638b25"
server_key_iv: "5874a32ebba75444ef5e75fc056aa19d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.515877  6730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "b48114b9cbb547fcbffc3397875205a2"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "76fc73bc8de7a65068eb3be454638b25"
server_key_iv: "5874a32ebba75444ef5e75fc056aa19d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.517270  6730 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:15.518052  6745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.518273  6730 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:15.518371  6730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "b48114b9cbb547fcbffc3397875205a2"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "76fc73bc8de7a65068eb3be454638b25"
server_key_iv: "5874a32ebba75444ef5e75fc056aa19d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.518453  6730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:15.525730  6730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:15.527906  6730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:15.528066  6730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:15.528303  6730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:15.528607  6730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:15.528662  6730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.528703  6730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:15.528734  6730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.534368  6730 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37543
I20260928 13:03:15.534407  6858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37543 every 8 connection(s)
I20260928 13:03:15.534742  6730 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:15.543246  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6730
I20260928 13:03:15.543371  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:15.543588  3096 external_mini_cluster.cc:1428] Setting key 5cd65996a7cd8c7a42c111ce7e49a10f
I20260928 13:03:15.544168  6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.535509 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:38925 (local address 127.3.6.62:36493)
0928 13:03:15.535582 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.535585 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.535798 (+   213us) server_negotiation.cc:407] Connection header received
0928 13:03:15.536719 (+   921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.536720 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.536734 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.536808 (+    74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.537386 (+   578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.537892 (+   506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.538879 (+   987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.539146 (+   267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.539199 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.541256 (+  2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.541258 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.541258 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.541269 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.542519 (+  1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.542919 (+   400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.542920 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.542920 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.542970 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.543348 (+   378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.543349 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.543349 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.543495 (+   146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.543548 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.543991 (+   443us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.544076 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:15.544349  6861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.535454 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36493 (local address 127.3.6.1:38925)
0928 13:03:15.535667 (+   213us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:15.535705 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:15.536629 (+   924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:15.536864 (+   235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:15.536868 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:15.537122 (+   254us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:15.537313 (+   191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.537317 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.537973 (+   656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.537973 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.538797 (+   824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.538799 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.539200 (+   401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.539211 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.539324 (+   113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.539799 (+   475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:15.539807 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:15.541158 (+  1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:15.542619 (+  1461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.542625 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.542627 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.542851 (+   224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.543096 (+   245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.543098 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.543098 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.543256 (+   158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.543547 (+   291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:15.543553 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:15.543791 (+   238us) client_negotiation.cc:769] Sending connection context
0928 13:03:15.543939 (+   148us) client_negotiation.cc:240] Negotiation successful
0928 13:03:15.544095 (+   156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260928 13:03:15.544770  6859 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36493
I20260928 13:03:15.544878  6859 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:15.545073  6859 heartbeater.cc:511] Master 127.3.6.62:36493 requested a full tablet report, sending...
I20260928 13:03:15.545673  6668 ts_manager.cc:194] Registered new tserver with Master: b48114b9cbb547fcbffc3397875205a2 (127.3.6.1:37543)
I20260928 13:03:15.546311  6668 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:38925
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:15.567924  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:15.648837  6864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:15.649051  6864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:15.649075  6864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:15.650267  6864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:15.650306  6864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:15.650332  6864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:15.652002  6864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6864
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:15.652263  6864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:15.652496  6864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:15.657791  6870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.657795  6872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.657835  6869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.658057  6864 server_base.cc:1034] running on GCE node
I20260928 13:03:15.658277  6864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:15.658514  6864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:15.659688  6864 hybrid_clock.cc:648] HybridClock initialized: now 1790600595659667 us; error 30 us; skew 500 ppm
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:15.662206  6864 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:15.662721  6864 webserver.cc:460] Webserver started at http://127.3.6.2:42625/ using document root <none> and password file <none>
I20260928 13:03:15.662946  6864 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:15.662992  6864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:15.663172  6864 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:15.664242  6864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "58b71b6f0fd849e29ff72a10301c8b33"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "7e6c538f75533ef162e49188f5f45279"
server_key_iv: "9c540fe1284dd61ea9009fd98d756b6d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.664616  6864 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "58b71b6f0fd849e29ff72a10301c8b33"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "7e6c538f75533ef162e49188f5f45279"
server_key_iv: "9c540fe1284dd61ea9009fd98d756b6d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.665916  6864 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:15.666659  6879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.666879  6864 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:15.666983  6864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "58b71b6f0fd849e29ff72a10301c8b33"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "7e6c538f75533ef162e49188f5f45279"
server_key_iv: "9c540fe1284dd61ea9009fd98d756b6d"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.667104  6864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:15.675056  6864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:15.677037  6864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:15.677184  6864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:15.677419  6864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:15.677726  6864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:15.677784  6864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.677827  6864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:15.677855  6864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.683748  6864 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:41863
I20260928 13:03:15.683827  6992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:41863 every 8 connection(s)
I20260928 13:03:15.684145  6864 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:15.692924  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6864
I20260928 13:03:15.693040  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:15.693250  3096 external_mini_cluster.cc:1428] Setting key 544679a55f7914db48cebba2dfde7853
I20260928 13:03:15.693967  6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.684887 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55989 (local address 127.3.6.62:36493)
0928 13:03:15.684946 (+    59us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.684948 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.685122 (+   174us) server_negotiation.cc:407] Connection header received
0928 13:03:15.686475 (+  1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.686476 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.686489 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.686545 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.687241 (+   696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.687762 (+   521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.688756 (+   994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.688935 (+   179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.688985 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.691218 (+  2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.691219 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.691220 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.691227 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.692453 (+  1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.692882 (+   429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.692883 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.692884 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.692953 (+    69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.693239 (+   286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.693239 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.693240 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.693382 (+   142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.693486 (+   104us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.693752 (+   266us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.693867 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:15.694120  6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.684873 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36493 (local address 127.3.6.2:55989)
0928 13:03:15.685020 (+   147us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:15.685055 (+    35us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:15.686356 (+  1301us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:15.686649 (+   293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:15.686653 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:15.686902 (+   249us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:15.687169 (+   267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.687174 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.687846 (+   672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.687847 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.688684 (+   837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.688686 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.688994 (+   308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.689003 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.689101 (+    98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.689575 (+   474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:15.689584 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:15.691133 (+  1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:15.692529 (+  1396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.692534 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.692536 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.692790 (+   254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.693047 (+   257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.693048 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.693049 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.693171 (+   122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.693470 (+   299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:15.693477 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:15.693631 (+   154us) client_negotiation.cc:769] Sending connection context
0928 13:03:15.693716 (+    85us) client_negotiation.cc:240] Negotiation successful
0928 13:03:15.693868 (+   152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":89,"threads_started":1}
I20260928 13:03:15.694581  6993 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36493
I20260928 13:03:15.694671  6993 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:15.694893  6993 heartbeater.cc:511] Master 127.3.6.62:36493 requested a full tablet report, sending...
I20260928 13:03:15.695335  6668 ts_manager.cc:194] Registered new tserver with Master: 58b71b6f0fd849e29ff72a10301c8b33 (127.3.6.2:41863)
I20260928 13:03:15.695940  6668 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:55989
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:15.718423  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:15.800673  6998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:15.800877  6998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:15.800901  6998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:15.802002  6998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:15.802037  6998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:15.802063  6998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:15.803519  6998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36493
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:15.803705  6998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:15.803875  6998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:15.808789  7006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.808967  6998 server_base.cc:1034] running on GCE node
W20260928 13:03:15.808851  7004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:15.808799  7003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:15.809324  6998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:15.809612  6998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:15.810770  6998 hybrid_clock.cc:648] HybridClock initialized: now 1790600595810766 us; error 39 us; skew 500 ppm
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:15.813431  6998 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:15.813853  6998 webserver.cc:460] Webserver started at http://127.3.6.3:40155/ using document root <none> and password file <none>
I20260928 13:03:15.814033  6998 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:15.814073  6998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:15.814160  6998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:15.815275  6998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "facf10dad22f4c9c94cbd3c947b4c284"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "51befbec343b25c18e05310e102db0d7"
server_key_iv: "83d132308367896a9d9e4cc1c0923c98"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.815586  6998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "facf10dad22f4c9c94cbd3c947b4c284"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "51befbec343b25c18e05310e102db0d7"
server_key_iv: "83d132308367896a9d9e4cc1c0923c98"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.816893  6998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:15.817615  7013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.817843  6998 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:15.817929  6998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "facf10dad22f4c9c94cbd3c947b4c284"
format_stamp: "Formatted at 2026-09-28 13:03:15 on dist-test-slave-ddvw"
server_key: "51befbec343b25c18e05310e102db0d7"
server_key_iv: "83d132308367896a9d9e4cc1c0923c98"
server_key_version: "encryptionkey@0"
I20260928 13:03:15.817984  6998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:15.828770  6998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:15.830636  6998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:15.830753  6998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:15.830947  6998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:15.831301  6998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:15.831336  6998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.831359  6998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:15.831408  6998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:15.836937  6998 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:38939
I20260928 13:03:15.837010  7126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:38939 every 8 connection(s)
I20260928 13:03:15.837352  6998 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:15.843178  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 6998
I20260928 13:03:15.843267  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:15.843487  3096 external_mini_cluster.cc:1428] Setting key 7b94d1c61e110feba42f1b243a079afd
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:15.846911  6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.838122 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37927 (local address 127.3.6.62:36493)
0928 13:03:15.838177 (+    55us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.838180 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.838385 (+   205us) server_negotiation.cc:407] Connection header received
0928 13:03:15.839386 (+  1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.839387 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.839397 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.839453 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.840049 (+   596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.840534 (+   485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.841516 (+   982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.841699 (+   183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.841757 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.844378 (+  2621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.844379 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.844379 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.844388 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.845654 (+  1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.846037 (+   383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.846038 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.846038 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.846089 (+    51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.846311 (+   222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.846311 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.846312 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.846416 (+   104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.846466 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.846707 (+   241us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.846825 (+   118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 13:03:15.846976  7129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.838111 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36493 (local address 127.3.6.3:37927)
0928 13:03:15.838252 (+   141us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:15.838289 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:15.839288 (+   999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:15.839511 (+   223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:15.839514 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:15.839778 (+   264us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:15.839971 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.839975 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.840610 (+   635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.840611 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.841432 (+   821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:15.841434 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.841764 (+   330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.841788 (+    24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:15.841889 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.842466 (+   577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:15.842475 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:15.844235 (+  1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:15.845741 (+  1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.845747 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.845748 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.845971 (+   223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.846148 (+   177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:15.846149 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:15.846149 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:15.846248 (+    99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:15.846471 (+   223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:15.846475 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:15.846596 (+   121us) client_negotiation.cc:769] Sending connection context
0928 13:03:15.846680 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:03:15.846806 (+   126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":81,"threads_started":1}
I20260928 13:03:15.847496  7127 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36493
I20260928 13:03:15.847595  7127 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:15.847797  7127 heartbeater.cc:511] Master 127.3.6.62:36493 requested a full tablet report, sending...
I20260928 13:03:15.848174  6668 ts_manager.cc:194] Registered new tserver with Master: facf10dad22f4c9c94cbd3c947b4c284 (127.3.6.3:38939)
I20260928 13:03:15.848572  6668 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:37927
I20260928 13:03:15.855400  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:15.878383  7134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.870489 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49070 (local address 127.3.6.1:37543)
0928 13:03:15.870664 (+   175us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.870669 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.870680 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:15.870707 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.870709 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.870779 (+    70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.870869 (+    90us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.871460 (+   591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.872187 (+   727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.872968 (+   781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.873337 (+   369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.873398 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.875882 (+  2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.875890 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.875891 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.875898 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.877389 (+  1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.877707 (+   318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.877710 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.877711 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.877770 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.877934 (+   164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.877935 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.877935 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.878069 (+   134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.878184 (+   115us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.878237 (+    53us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.878299 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":93,"threads_started":1}
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[6623](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600595, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:15.886909  6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:15.879757 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.3.6.62:36493)
0928 13:03:15.879821 (+    64us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:15.879823 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:15.879871 (+    48us) server_negotiation.cc:407] Connection header received
0928 13:03:15.879948 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:15.879949 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:15.879959 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:15.880031 (+    72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:15.880504 (+   473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.880992 (+   488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.881692 (+   700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:15.881890 (+   198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:15.881996 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:15.884339 (+  2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:15.884341 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:15.884341 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:15.884349 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:15.885524 (+  1175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.885975 (+   451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.885976 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.885976 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.886039 (+    63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:15.886239 (+   200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:15.886240 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:15.886241 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:15.886403 (+   162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:15.886522 (+   119us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:15.886700 (+   178us) server_negotiation.cc:299] Negotiation successful
0928 13:03:15.886801 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260928 13:03:15.887200  6668 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58464
I20260928 13:03:15.887588  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6730
I20260928 13:03:15.892107  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6864
I20260928 13:03:15.896354  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6998
I20260928 13:03:15.900631  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 6636
2026-09-28T13:03:15Z chronyd exiting
[       OK ] SecurityITest.TestAuthorizedSuperuser (1922 ms)
[ RUN      ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[7139](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[7139](info): set up 2 sockets
Sep 28 13:03:15 dist-test-slave-ddvw krb5kdc[7139](info): commencing operation
krb5kdc: starting...
W20260928 13:03:16.939383  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.019s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:17.058347  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45229
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:45229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:17.140065  7152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:17.140314  7152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:17.140352  7152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:17.141510  7152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:17.141584  7152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:17.141609  7152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:17.141640  7152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:17.141686  7152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:17.143287  7152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:45229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:17.143573  7152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:17.143816  7152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:17.148792  7157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.148880  7158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.148788  7160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:17.149041  7152 server_base.cc:1034] running on GCE node
I20260928 13:03:17.149317  7152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:17.149627  7152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:17.150820  7152 hybrid_clock.cc:648] HybridClock initialized: now 1790600597150796 us; error 37 us; skew 500 ppm
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:17.159335  7152 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:17.159772  7152 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:17.159865  7152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:17.160036  7152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:17.161257  7152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "00f3bcccb202f87ecde5add2957dc7cf"
server_key_iv: "c4feaf8899dc7fd2fb8f9d748096fdf7"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.161669  7152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "00f3bcccb202f87ecde5add2957dc7cf"
server_key_iv: "c4feaf8899dc7fd2fb8f9d748096fdf7"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.163256  7152 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:17.164057  7166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.164235  7152 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:17.164357  7152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "00f3bcccb202f87ecde5add2957dc7cf"
server_key_iv: "c4feaf8899dc7fd2fb8f9d748096fdf7"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.164439  7152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:17.213901  7152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:17.215984  7152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:17.216159  7152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:17.220287  7152 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:45229
I20260928 13:03:17.220319  7218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:45229 every 8 connection(s)
I20260928 13:03:17.220623  7152 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:17.221581  7219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:17.223738  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7152
I20260928 13:03:17.223839  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:17.224020  3096 external_mini_cluster.cc:1428] Setting key 2ad996e69828d254e7cf87f8bf57ede5
I20260928 13:03:17.224107  7219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: Bootstrap starting.
I20260928 13:03:17.224864  7219 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:17.225158  7219 log.cc:824] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:17.225970  7219 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: No bootstrap required, opened a new log
I20260928 13:03:17.228174  7219 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } }
I20260928 13:03:17.228338  7219 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:17.228372  7219 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f4a76b5e8e4b46bbd3c3385aa622f1, State: Initialized, Role: FOLLOWER
I20260928 13:03:17.228493  7219 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } }
I20260928 13:03:17.228588  7219 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:17.228613  7219 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:17.228684  7219 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:17.229254  7219 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } }
I20260928 13:03:17.229367  7219 leader_election.cc:302] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00f4a76b5e8e4b46bbd3c3385aa622f1; no voters: 
I20260928 13:03:17.229547  7219 leader_election.cc:288] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:17.229571  7224 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:17.229673  7224 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [term 1 LEADER]: Becoming Leader. State: Replica: 00f4a76b5e8e4b46bbd3c3385aa622f1, State: Running, Role: LEADER
I20260928 13:03:17.229743  7224 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } }
I20260928 13:03:17.229796  7219 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:17.230037  7224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00f4a76b5e8e4b46bbd3c3385aa622f1. Latest consensus state: current_term: 1 leader_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } } }
I20260928 13:03:17.230104  7224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:17.230343  7225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f4a76b5e8e4b46bbd3c3385aa622f1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45229 } } }
I20260928 13:03:17.230427  7225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:17.230659  7228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:17.231173  7228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:17.232831  7228 catalog_manager.cc:1347] Generated new cluster ID: b315ab125c2c48efb29486ca8a6e4324
I20260928 13:03:17.232884  7228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:17.238166  7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.224541 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45918 (local address 127.3.6.62:45229)
0928 13:03:17.224720 (+   179us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.224730 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.224771 (+    41us) server_negotiation.cc:407] Connection header received
0928 13:03:17.225390 (+   619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.225401 (+    11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.225475 (+    74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.225639 (+   164us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:17.226399 (+   760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.227411 (+  1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.228539 (+  1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.229081 (+   542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.229174 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.232260 (+  3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:17.232264 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:17.232264 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:17.232275 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:17.236461 (+  4186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.236915 (+   454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.236919 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.236919 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.237017 (+    98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.237255 (+   238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.237256 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.237256 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.237513 (+   257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:17.237698 (+   185us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.237789 (+    91us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.237955 (+   166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260928 13:03:17.246953  7228 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:17.247776  7228 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:17.251893  7228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: Generated new TSK 0
I20260928 13:03:17.252120  7228 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:17.281275  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:17.362666  7245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:17.362912  7245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:17.362953  7245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:17.364151  7245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:17.364221  7245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:17.364269  7245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:17.365780  7245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:17.366043  7245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:17.366271  7245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:17.371325  7253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.371358  7251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.371351  7250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:17.371481  7245 server_base.cc:1034] running on GCE node
I20260928 13:03:17.371712  7245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:17.371980  7245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:17.373145  7245 hybrid_clock.cc:648] HybridClock initialized: now 1790600597373132 us; error 50 us; skew 500 ppm
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:17.375819  7245 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:17.376204  7245 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:17.376274  7245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:17.376438  7245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:17.377516  7245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "254a6670b8ec4f6db63a29fc4e9ef218"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1381cda0ea5d1f14b3cd00f33e022263"
server_key_iv: "9e511ba7bfd79f223907e8d8f9f6a799"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.377883  7245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "254a6670b8ec4f6db63a29fc4e9ef218"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1381cda0ea5d1f14b3cd00f33e022263"
server_key_iv: "9e511ba7bfd79f223907e8d8f9f6a799"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.379200  7245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:17.379930  7259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.380093  7245 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:17.380188  7245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "254a6670b8ec4f6db63a29fc4e9ef218"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1381cda0ea5d1f14b3cd00f33e022263"
server_key_iv: "9e511ba7bfd79f223907e8d8f9f6a799"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.380270  7245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:17.392750  7245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:17.395196  7245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:17.395366  7245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:17.395622  7245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:17.395924  7245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:17.395977  7245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.396010  7245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:17.396055  7245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.401786  7245 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37669
I20260928 13:03:17.401830  7372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37669 every 8 connection(s)
I20260928 13:03:17.402084  7245 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:17.406364  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7245
I20260928 13:03:17.406476  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:17.406679  3096 external_mini_cluster.cc:1428] Setting key 39abe78ac077353e99e72ad914280849
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:17.411285  7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.402778 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43975 (local address 127.3.6.62:45229)
0928 13:03:17.402848 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.402850 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.403062 (+   212us) server_negotiation.cc:407] Connection header received
0928 13:03:17.403553 (+   491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.403554 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.403563 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.403630 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:17.404486 (+   856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.404989 (+   503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.405939 (+   950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.406123 (+   184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.406189 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.408551 (+  2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:17.408554 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:17.408554 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:17.408561 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:17.409883 (+  1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.410286 (+   403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.410287 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.410287 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.410355 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.410609 (+   254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.410610 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.410610 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.410724 (+   114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:17.410800 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.411108 (+   308us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.411198 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 13:03:17.411470  7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.402739 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45229 (local address 127.3.6.1:43975)
0928 13:03:17.402908 (+   169us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.402948 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.403473 (+   525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.403683 (+   210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.403686 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.403930 (+   244us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:17.404411 (+   481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.404416 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.405065 (+   649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.405066 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.405867 (+   801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.405869 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.406203 (+   334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.406216 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.406388 (+   172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.406993 (+   605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:17.407004 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:17.408451 (+  1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:17.409975 (+  1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.409982 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.409984 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.410197 (+   213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.410425 (+   228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.410426 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.410426 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.410539 (+   113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.410792 (+   253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:17.410798 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:17.410941 (+   143us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.411086 (+   145us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.411242 (+   156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":100,"threads_started":1}
I20260928 13:03:17.412293  7373 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45229
I20260928 13:03:17.412401  7373 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:17.412580  7373 heartbeater.cc:511] Master 127.3.6.62:45229 requested a full tablet report, sending...
I20260928 13:03:17.413159  7183 ts_manager.cc:194] Registered new tserver with Master: 254a6670b8ec4f6db63a29fc4e9ef218 (127.3.6.1:37669)
I20260928 13:03:17.414104  7183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:43975
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:17.431279  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:17.512151  7378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:17.512352  7378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:17.512375  7378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:17.513500  7378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:17.513541  7378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:17.513567  7378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:17.515172  7378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:17.515419  7378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:17.515656  7378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:17.520460  7384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.520449  7383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:17.520494  7378 server_base.cc:1034] running on GCE node
W20260928 13:03:17.520460  7386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:17.520818  7378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:17.521075  7378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:17.522253  7378 hybrid_clock.cc:648] HybridClock initialized: now 1790600597522230 us; error 43 us; skew 500 ppm
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:17.524845  7378 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:17.525204  7378 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:17.525251  7378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:17.525427  7378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:17.526496  7378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "166fd1fc9f844f8b8d3c315fde0a2c52"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "d2bf41b4c94d7f6a069635f79e141258"
server_key_iv: "b14752c305c874cd72ffcb93535a16c5"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.526854  7378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "166fd1fc9f844f8b8d3c315fde0a2c52"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "d2bf41b4c94d7f6a069635f79e141258"
server_key_iv: "b14752c305c874cd72ffcb93535a16c5"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.528196  7378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:17.528923  7392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.529088  7378 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:17.529173  7378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "166fd1fc9f844f8b8d3c315fde0a2c52"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "d2bf41b4c94d7f6a069635f79e141258"
server_key_iv: "b14752c305c874cd72ffcb93535a16c5"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.529240  7378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:17.546124  7378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:17.548525  7378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:17.548636  7378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:17.548825  7378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:17.549196  7378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:17.549230  7378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.549253  7378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:17.549265  7378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.554883  7378 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44133
I20260928 13:03:17.554950  7505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44133 every 8 connection(s)
I20260928 13:03:17.555243  7378 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:17.556053  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7378
I20260928 13:03:17.556157  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:17.556360  3096 external_mini_cluster.cc:1428] Setting key f8956b9ee36755402cbc1fddb43e3872
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:03:17.565244  7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.556015 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:36689 (local address 127.3.6.62:45229)
0928 13:03:17.556083 (+    68us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.556086 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.556340 (+   254us) server_negotiation.cc:407] Connection header received
0928 13:03:17.556886 (+   546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.556887 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.556898 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.556972 (+    74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:17.558298 (+  1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.558813 (+   515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.559910 (+  1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.560102 (+   192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.560189 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.562337 (+  2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:17.562338 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:17.562338 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:17.562346 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:17.563797 (+  1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.564271 (+   474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.564272 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.564273 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.564331 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.564588 (+   257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.564589 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.564589 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.564699 (+   110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:17.564772 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.565097 (+   325us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.565180 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 13:03:17.565428  7508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.555973 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45229 (local address 127.3.6.2:36689)
0928 13:03:17.556201 (+   228us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.556244 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.556802 (+   558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.557059 (+   257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.557064 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.557491 (+   427us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:17.558186 (+   695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.558194 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.558908 (+   714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.558909 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.559802 (+   893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.559804 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.560201 (+   397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.560213 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.560348 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.560893 (+   545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:17.560906 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:17.562224 (+  1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:17.563897 (+  1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.563904 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.563906 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.564184 (+   278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.564398 (+   214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.564399 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.564400 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.564512 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.564764 (+   252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:17.564770 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:17.564951 (+   181us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.565065 (+   114us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.565198 (+   133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":99,"threads_started":1}
I20260928 13:03:17.565963  7506 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45229
I20260928 13:03:17.566045  7506 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:17.566152  7506 heartbeater.cc:511] Master 127.3.6.62:45229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
I20260928 13:03:17.566594  7183 ts_manager.cc:194] Registered new tserver with Master: 166fd1fc9f844f8b8d3c315fde0a2c52 (127.3.6.2:44133)
I20260928 13:03:17.567001  7183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:36689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:17.580018  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:17.660221  7511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:17.660432  7511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:17.660456  7511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:17.661659  7511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:17.661710  7511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:17.661736  7511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:17.663264  7511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:17.663532  7511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:17.663763  7511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:17.668738  7519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.668751  7517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:17.668802  7516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:17.669190  7511 server_base.cc:1034] running on GCE node
I20260928 13:03:17.669399  7511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:17.669608  7511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:17.670750  7511 hybrid_clock.cc:648] HybridClock initialized: now 1790600597670735 us; error 32 us; skew 500 ppm
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:17.673367  7511 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:17.673699  7511 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:17.673741  7511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:17.673836  7511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:17.674981  7511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "8314b1b33c7d4e4b82301a7bf57d1988"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1ae52bf25854e15dfda179e9bcd40fb8"
server_key_iv: "638e7cb536987fb71b1d8479d6036432"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.675443  7511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "8314b1b33c7d4e4b82301a7bf57d1988"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1ae52bf25854e15dfda179e9bcd40fb8"
server_key_iv: "638e7cb536987fb71b1d8479d6036432"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.676756  7511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:17.677466  7525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.677759  7511 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:17.677845  7511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "8314b1b33c7d4e4b82301a7bf57d1988"
format_stamp: "Formatted at 2026-09-28 13:03:17 on dist-test-slave-ddvw"
server_key: "1ae52bf25854e15dfda179e9bcd40fb8"
server_key_iv: "638e7cb536987fb71b1d8479d6036432"
server_key_version: "encryptionkey@0"
I20260928 13:03:17.677928  7511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:17.695035  7511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:17.697113  7511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:17.697257  7511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:17.697505  7511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:17.697829  7511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:17.697861  7511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.697883  7511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:17.697928  7511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:17.703557  7511 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45817
I20260928 13:03:17.703598  7638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45817 every 8 connection(s)
I20260928 13:03:17.703860  7511 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:17.704864  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7511
I20260928 13:03:17.704977  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:17.705173  3096 external_mini_cluster.cc:1428] Setting key 30cf01d8727ecb77d78b53c396fe2592
Sep 28 13:03:17 dist-test-slave-ddvw krb5kdc[7139](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600597, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:17.712728  7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.704573 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:52937 (local address 127.3.6.62:45229)
0928 13:03:17.704633 (+    60us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.704635 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.704834 (+   199us) server_negotiation.cc:407] Connection header received
0928 13:03:17.705431 (+   597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.705433 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.705444 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.705510 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:17.706568 (+  1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.707115 (+   547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.708081 (+   966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.708272 (+   191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.708328 (+    56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.710237 (+  1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:17.710238 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:17.710238 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:17.710244 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:17.711621 (+  1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.711992 (+   371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.711992 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.711993 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.712041 (+    48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.712238 (+   197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.712238 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.712238 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.712328 (+    90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:17.712376 (+    48us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.712585 (+   209us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.712637 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 13:03:17.712847  7641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.704536 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45229 (local address 127.3.6.3:52937)
0928 13:03:17.704693 (+   157us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.704734 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.705328 (+   594us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.705589 (+   261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.705593 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.705959 (+   366us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:17.706486 (+   527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.706491 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.707191 (+   700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.707192 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.708001 (+   809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.708003 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.708335 (+   332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.708343 (+     8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.708439 (+    96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.708875 (+   436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:17.708882 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:17.710160 (+  1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:17.711727 (+  1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.711732 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.711733 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.711929 (+   196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.712100 (+   171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:17.712101 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:17.712101 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:17.712186 (+    85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:17.712377 (+   191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:17.712381 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:17.712483 (+   102us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.712561 (+    78us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.712667 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260928 13:03:17.713269  7639 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45229
I20260928 13:03:17.713351  7639 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:17.713512  7639 heartbeater.cc:511] Master 127.3.6.62:45229 requested a full tablet report, sending...
I20260928 13:03:17.713871  7183 ts_manager.cc:194] Registered new tserver with Master: 8314b1b33c7d4e4b82301a7bf57d1988 (127.3.6.3:45817)
I20260928 13:03:17.714306  7183 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:52937
I20260928 13:03:17.716706  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:17.723968  7222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.718061 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45920 (local address 127.3.6.62:45229)
0928 13:03:17.718129 (+    68us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.718131 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.718219 (+    88us) server_negotiation.cc:407] Connection header received
0928 13:03:17.718292 (+    73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.718293 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.718302 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.718370 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:17.718920 (+   550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.719460 (+   540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.720214 (+   754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.720419 (+   205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.720500 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.721614 (+  1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:17.721615 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:17.721616 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:17.721622 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:17.722742 (+  1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.723182 (+   440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.723183 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.723183 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.723241 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:17.723434 (+   193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:17.723435 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:17.723435 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:17.723576 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:17.723682 (+   106us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.723789 (+   107us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.723870 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 13:03:17.725446  7183 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45920:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:17.726890  7183 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:17.733353  7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.728976 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37669 (local address 127.0.0.1:42232)
0928 13:03:17.729316 (+   340us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.729325 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.729375 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.729652 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.729653 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.729655 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:17.729700 (+    45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.729701 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.730947 (+  1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.730948 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.732106 (+  1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.732108 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.733038 (+   930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733039 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.733121 (+    82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733136 (+    15us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.733214 (+    78us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.733276 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":4,"thread_start_us":46,"threads_started":1}
I20260928 13:03:17.733366  7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.729097 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42232 (local address 127.3.6.1:37669)
0928 13:03:17.729309 (+   212us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.729314 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.729375 (+    61us) server_negotiation.cc:407] Connection header received
0928 13:03:17.729448 (+    73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.729450 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.729471 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.729572 (+   101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:17.729792 (+   220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.730836 (+  1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.732190 (+  1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.732933 (+   743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733019 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733077 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.733237 (+   160us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.733281 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260928 13:03:17.733765  7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.728976 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44133 (local address 127.0.0.1:36670)
0928 13:03:17.729124 (+   148us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.729162 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.729220 (+    58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.729552 (+   332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.729555 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.729558 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:17.729621 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.729623 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.731119 (+  1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.731120 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.732561 (+  1441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.732562 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.733521 (+   959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733521 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.733582 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733590 (+     8us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.733660 (+    70us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.733698 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":312,"thread_start_us":54,"threads_started":1}
I20260928 13:03:17.733779  7652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.729352 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52682 (local address 127.3.6.3:45817)
0928 13:03:17.729732 (+   380us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.729736 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.729745 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:17.729781 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.729783 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.729806 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.729876 (+    70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:17.730072 (+   196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.731135 (+  1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.732451 (+  1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.733152 (+   701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733239 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733299 (+    60us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.733659 (+   360us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.733699 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":90,"threads_started":1}
I20260928 13:03:17.733995  7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.729148 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45817 (local address 127.0.0.1:52682)
0928 13:03:17.729446 (+   298us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.729454 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.729489 (+    35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.729950 (+   461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.729951 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.729953 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:17.729990 (+    37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.729991 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.731229 (+  1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.731230 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.732359 (+  1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.732361 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.733333 (+   972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733334 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.733399 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733404 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.733456 (+    52us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.733934 (+   478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":43,"threads_started":1}
I20260928 13:03:17.734138  7307 tablet_service.cc:1467] Processing CreateTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 (DEFAULT_TABLE table=test-table [id=c4e90d6126384fedb4bea40680337ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:17.734416  7307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a0599bf40140d2bf07f3bf41b36d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:17.735355  7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.729097 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36670 (local address 127.3.6.2:44133)
0928 13:03:17.729388 (+   291us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.729392 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.729403 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:17.729444 (+    41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.729446 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.729462 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.729549 (+    87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:17.729774 (+   225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.731034 (+  1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.732643 (+  1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.733366 (+   723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.733432 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.733488 (+    56us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.733674 (+   186us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.733708 (+    34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":84,"threads_started":1}
I20260928 13:03:17.735743  7573 tablet_service.cc:1467] Processing CreateTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 (DEFAULT_TABLE table=test-table [id=c4e90d6126384fedb4bea40680337ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:17.736075  7573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a0599bf40140d2bf07f3bf41b36d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:17.736109  7440 tablet_service.cc:1467] Processing CreateTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 (DEFAULT_TABLE table=test-table [id=c4e90d6126384fedb4bea40680337ed4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:17.736438  7440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a0599bf40140d2bf07f3bf41b36d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:17.737541  7653 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Bootstrap starting.
I20260928 13:03:17.738423  7653 tablet_bootstrap.cc:654] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:17.739041  7653 log.cc:824] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:17.739085  7654 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Bootstrap starting.
I20260928 13:03:17.739773  7653 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: No bootstrap required, opened a new log
I20260928 13:03:17.739830  7653 ts_tablet_manager.cc:1397] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:17.739972  7654 tablet_bootstrap.cc:654] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:17.740453  7654 log.cc:824] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:17.741124  7654 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: No bootstrap required, opened a new log
I20260928 13:03:17.741204  7654 ts_tablet_manager.cc:1397] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260928 13:03:17.741618  7653 raft_consensus.cc:348] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.741797  7653 raft_consensus.cc:374] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:17.741859  7653 raft_consensus.cc:729] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 254a6670b8ec4f6db63a29fc4e9ef218, State: Initialized, Role: FOLLOWER
I20260928 13:03:17.741974  7653 consensus_queue.cc:260] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.742241  7653 ts_tablet_manager.cc:1428] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:17.742282  7373 heartbeater.cc:503] Master 127.3.6.62:45229 was elected leader, sending a full tablet report...
I20260928 13:03:17.739416  7656 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Bootstrap starting.
I20260928 13:03:17.742880  7656 tablet_bootstrap.cc:654] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:17.743533  7656 log.cc:824] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:17.743814  7654 raft_consensus.cc:348] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.743932  7654 raft_consensus.cc:374] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:17.743953  7654 raft_consensus.cc:729] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8314b1b33c7d4e4b82301a7bf57d1988, State: Initialized, Role: FOLLOWER
I20260928 13:03:17.744084  7654 consensus_queue.cc:260] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.744261  7656 tablet_bootstrap.cc:492] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: No bootstrap required, opened a new log
I20260928 13:03:17.744340  7656 ts_tablet_manager.cc:1397] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.001s
I20260928 13:03:17.744380  7654 ts_tablet_manager.cc:1428] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.001s
I20260928 13:03:17.744393  7639 heartbeater.cc:503] Master 127.3.6.62:45229 was elected leader, sending a full tablet report...
I20260928 13:03:17.746279  7656 raft_consensus.cc:348] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.746400  7656 raft_consensus.cc:374] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:17.746420  7656 raft_consensus.cc:729] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166fd1fc9f844f8b8d3c315fde0a2c52, State: Initialized, Role: FOLLOWER
I20260928 13:03:17.746518  7656 consensus_queue.cc:260] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.746771  7656 ts_tablet_manager.cc:1428] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.003s
I20260928 13:03:17.746786  7506 heartbeater.cc:503] Master 127.3.6.62:45229 was elected leader, sending a full tablet report...
W20260928 13:03:17.805825  7507 tablet.cc:2369] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:17.902712  7374 tablet.cc:2369] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:17.903671  7658 raft_consensus.cc:482] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:17.903761  7658 raft_consensus.cc:504] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.904069  7658 leader_election.cc:288] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 166fd1fc9f844f8b8d3c315fde0a2c52 (127.3.6.2:44133), 8314b1b33c7d4e4b82301a7bf57d1988 (127.3.6.3:45817)
I20260928 13:03:17.908196  7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.904356 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:37741 (local address 127.3.6.2:44133)
0928 13:03:17.904421 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.904424 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.904436 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:17.904467 (+    31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.904468 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.904480 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.904559 (+    79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:17.904918 (+   359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.905816 (+   898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907185 (+  1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.907785 (+   600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907862 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.907871 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.908087 (+   216us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.908126 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:03:17.908196  7652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.904528 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47197 (local address 127.3.6.3:45817)
0928 13:03:17.904572 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.904573 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.904582 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:17.904619 (+    37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.904620 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.904630 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.904676 (+    46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:17.904931 (+   255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.905634 (+   703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907197 (+  1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.907785 (+   588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907862 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.907871 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.908087 (+   216us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.908126 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:17.908213  7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.904275 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44133 (local address 127.3.6.1:37741)
0928 13:03:17.904335 (+    60us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.904348 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.904396 (+    48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.904580 (+   184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.904581 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.904583 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:17.904703 (+   120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.904705 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.905922 (+  1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.905923 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.907089 (+  1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.907092 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.907905 (+   813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907906 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.908001 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.908002 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.908070 (+    68us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.908123 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":31}
I20260928 13:03:17.908222  7662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.904397 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45817 (local address 127.3.6.1:47197)
0928 13:03:17.904487 (+    90us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.904496 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:17.904562 (+    66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:17.904700 (+   138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:17.904701 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:17.904702 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:17.904767 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.904768 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.905721 (+   953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.905723 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.907089 (+  1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:17.907092 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.907905 (+   813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.907906 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:17.907997 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.908002 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:17.908070 (+    68us) client_negotiation.cc:240] Negotiation successful
0928 13:03:17.908123 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":18,"thread_start_us":63,"threads_started":1}
I20260928 13:03:17.908605  7460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a0599bf40140d2bf07f3bf41b36d83" candidate_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" is_pre_election: true
I20260928 13:03:17.908785  7460 raft_consensus.cc:2454] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 254a6670b8ec4f6db63a29fc4e9ef218 in term 0.
I20260928 13:03:17.908809  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a0599bf40140d2bf07f3bf41b36d83" candidate_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" is_pre_election: true
I20260928 13:03:17.908990  7593 raft_consensus.cc:2454] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 254a6670b8ec4f6db63a29fc4e9ef218 in term 0.
I20260928 13:03:17.909016  7261 leader_election.cc:302] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166fd1fc9f844f8b8d3c315fde0a2c52, 254a6670b8ec4f6db63a29fc4e9ef218; no voters: 
I20260928 13:03:17.909122  7658 raft_consensus.cc:2781] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:17.909186  7658 raft_consensus.cc:482] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:17.909212  7658 raft_consensus.cc:3037] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:17.909893  7658 raft_consensus.cc:504] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.909999  7658 leader_election.cc:288] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [CANDIDATE]: Term 1 election: Requested vote from peers 166fd1fc9f844f8b8d3c315fde0a2c52 (127.3.6.2:44133), 8314b1b33c7d4e4b82301a7bf57d1988 (127.3.6.3:45817)
I20260928 13:03:17.910202  7460 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a0599bf40140d2bf07f3bf41b36d83" candidate_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52"
I20260928 13:03:17.910209  7593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a0599bf40140d2bf07f3bf41b36d83" candidate_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8314b1b33c7d4e4b82301a7bf57d1988"
I20260928 13:03:17.910302  7593 raft_consensus.cc:3037] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:17.910306  7460 raft_consensus.cc:3037] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:17.911089  7593 raft_consensus.cc:2454] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 254a6670b8ec4f6db63a29fc4e9ef218 in term 1.
I20260928 13:03:17.911090  7460 raft_consensus.cc:2454] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 254a6670b8ec4f6db63a29fc4e9ef218 in term 1.
I20260928 13:03:17.911266  7261 leader_election.cc:302] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166fd1fc9f844f8b8d3c315fde0a2c52, 254a6670b8ec4f6db63a29fc4e9ef218; no voters: 
I20260928 13:03:17.911367  7658 raft_consensus.cc:2781] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:17.911562  7658 raft_consensus.cc:686] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 1 LEADER]: Becoming Leader. State: Replica: 254a6670b8ec4f6db63a29fc4e9ef218, State: Running, Role: LEADER
I20260928 13:03:17.911670  7658 consensus_queue.cc:237] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } }
I20260928 13:03:17.912499  7183 catalog_manager.cc:5495] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 reported cstate change: term changed from 0 to 1, leader changed from <none> to 254a6670b8ec4f6db63a29fc4e9ef218 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "254a6670b8ec4f6db63a29fc4e9ef218" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 } health_report { overall_health: UNKNOWN } } }
W20260928 13:03:17.954435  7640 tablet.cc:2369] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:17.960857  7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.958499 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42240 (local address 127.3.6.1:37669)
0928 13:03:17.958556 (+    57us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:17.958558 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:17.958567 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:17.958617 (+    50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:17.958617 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:17.958636 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:17.958748 (+   112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:17.958893 (+   145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.959392 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.960139 (+   747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:17.960350 (+   211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:17.960421 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:17.960554 (+   133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:17.960662 (+   108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:17.960724 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:17.960757 (+    33us) server_negotiation.cc:299] Negotiation successful
0928 13:03:17.960777 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:17.962886  7593 raft_consensus.cc:1261] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 1 FOLLOWER]: Refusing update from remote peer 254a6670b8ec4f6db63a29fc4e9ef218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:17.962886  7460 raft_consensus.cc:1261] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 1 FOLLOWER]: Refusing update from remote peer 254a6670b8ec4f6db63a29fc4e9ef218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:17.963320  7663 consensus_queue.cc:1035] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8314b1b33c7d4e4b82301a7bf57d1988" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:17.963467  7658 consensus_queue.cc:1035] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "166fd1fc9f844f8b8d3c315fde0a2c52" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:17.966173  7668 mvcc.cc:205] Tried to move back new op lower bound from 7334300049252777984 to 7334300049046970368. Current Snapshot: MvccSnapshot[applied={T|T < 7334300049252777984}]
I20260928 13:03:17.966424  7667 mvcc.cc:205] Tried to move back new op lower bound from 7334300049252777984 to 7334300049046970368. Current Snapshot: MvccSnapshot[applied={T|T < 7334300049252777984}]
I20260928 13:03:17.968878  7183 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:17.968973  7183 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45920:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:17.969762  7183 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00f4a76b5e8e4b46bbd3c3385aa622f1: Sending DeleteTablet for 3 replicas of tablet 88a0599bf40140d2bf07f3bf41b36d83
I20260928 13:03:17.970057  7307 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:17 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42232
I20260928 13:03:17.970101  7573 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:17 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:52682
I20260928 13:03:17.970112  7440 tablet_service.cc:1514] Processing DeleteTablet for tablet 88a0599bf40140d2bf07f3bf41b36d83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:17 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36670
I20260928 13:03:17.970366  7676 tablet_replica.cc:330] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218: stopping tablet replica
I20260928 13:03:17.970465  7676 raft_consensus.cc:2229] T 88a0599bf40140d2bf07f3bf41b36d83 P 254a6670b8ec4f6db63a29fc4e9ef218 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:17.970577  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7245
I20260928 13:03:17.975214  7677 tablet_replica.cc:330] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: stopping tablet replica
I20260928 13:03:17.975214  7678 tablet_replica.cc:330] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: stopping tablet replica
I20260928 13:03:17.975361  7677 raft_consensus.cc:2229] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:17.975361  7678 raft_consensus.cc:2229] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:17.975487  7678 raft_consensus.cc:2258] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:17.975502  7677 raft_consensus.cc:2258] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:17.975999  7678 ts_tablet_manager.cc:1905] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 13:03:17.977010  7169 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:37669 (error 108)
I20260928 13:03:17.977432  7677 ts_tablet_manager.cc:1905] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:17.977581  7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.977384 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37669 (local address 127.0.0.1:42256)
0928 13:03:17.977454 (+    70us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.977542 (+    88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:03:17.977677  7678 ts_tablet_manager.cc:1918] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:17.977738  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7378
I20260928 13:03:17.977787  7678 log.cc:1196] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/88a0599bf40140d2bf07f3bf41b36d83
W20260928 13:03:17.977803  7169 catalog_manager.cc:4584] TS 254a6670b8ec4f6db63a29fc4e9ef218 (127.3.6.1:37669): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 88a0599bf40140d2bf07f3bf41b36d83: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37669: connect: Connection refused (error 111)
I20260928 13:03:17.978070  7678 ts_tablet_manager.cc:1939] T 88a0599bf40140d2bf07f3bf41b36d83 P 166fd1fc9f844f8b8d3c315fde0a2c52: Deleting consensus metadata
I20260928 13:03:17.979199  7677 ts_tablet_manager.cc:1918] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:17.979326  7677 log.cc:1196] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/88a0599bf40140d2bf07f3bf41b36d83
I20260928 13:03:17.979619  7677 ts_tablet_manager.cc:1939] T 88a0599bf40140d2bf07f3bf41b36d83 P 8314b1b33c7d4e4b82301a7bf57d1988: Deleting consensus metadata
I20260928 13:03:17.980119  7168 catalog_manager.cc:4841] TS 8314b1b33c7d4e4b82301a7bf57d1988 (127.3.6.3:45817): tablet 88a0599bf40140d2bf07f3bf41b36d83 (table test-table [id=c4e90d6126384fedb4bea40680337ed4]) successfully deleted
I20260928 13:03:17.982713  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7511
I20260928 13:03:17.982870  7648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:17.982681 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44133 (local address 127.0.0.1:36672)
0928 13:03:17.982779 (+    98us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:17.982830 (+    51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:44133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 13:03:17.987528  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7152
2026-09-28T13:03:17Z chronyd exiting
[       OK ] SecurityITest.TestDisableWebUI (2087 ms)
[ RUN      ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-28T13:03:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:18Z Disabled control of system clock
I20260928 13:03:18.014683  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37561
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 13:03:18.094758  7683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:18.094964  7683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:18.094985  7683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:18.096170  7683 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:18.096212  7683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:18.096225  7683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:18.096237  7683 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:18.096249  7683 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:18.097572  7683 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37561
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:18.097779  7683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:18.098037  7683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:18.102850  7689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.102860  7688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.102947  7691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.103119  7683 server_base.cc:1034] running on GCE node
I20260928 13:03:18.103461  7683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:18.103713  7683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:18.104851  7683 hybrid_clock.cc:648] HybridClock initialized: now 1790600598104831 us; error 38 us; skew 500 ppm
I20260928 13:03:18.106081  7683 webserver.cc:460] Webserver started at http://127.3.6.62:45821/ using document root <none> and password file <none>
I20260928 13:03:18.106274  7683 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:18.106331  7683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:18.106421  7683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:18.107548  7683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "784e6ebb5c964d03b9d7435e1ef1ca39"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "09e23928ab8d62b178af4e82de5a69cb"
server_key_iv: "fa8a25fc59f99edd9622170c8c69f7f3"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.107868  7683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "784e6ebb5c964d03b9d7435e1ef1ca39"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "09e23928ab8d62b178af4e82de5a69cb"
server_key_iv: "fa8a25fc59f99edd9622170c8c69f7f3"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.109066  7683 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:18.109810  7697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.110018  7683 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:18.110087  7683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "784e6ebb5c964d03b9d7435e1ef1ca39"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "09e23928ab8d62b178af4e82de5a69cb"
server_key_iv: "fa8a25fc59f99edd9622170c8c69f7f3"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.110138  7683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:18.113356  7683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:18.113566  7683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:18.113658  7683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:18.117406  7683 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:37561
I20260928 13:03:18.117435  7749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:37561 every 8 connection(s)
I20260928 13:03:18.117758  7683 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:18.118363  7750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:18.118691  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7683
I20260928 13:03:18.118798  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:18.118988  3096 external_mini_cluster.cc:1428] Setting key 23c8130281a7489b528564a8f47043e1
I20260928 13:03:18.121590  7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.119540 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.3.6.62:37561)
0928 13:03:18.119724 (+   184us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.119731 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.119754 (+    23us) server_negotiation.cc:407] Connection header received
0928 13:03:18.120248 (+   494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.120255 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.120308 (+    53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.120421 (+   113us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.121107 (+   686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.121110 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.121111 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.121114 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.121151 (+    37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.121160 (+     9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.121214 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.121306 (+    92us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.121376 (+    70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":82,"threads_started":1}
I20260928 13:03:18.122304  7750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: Bootstrap starting.
I20260928 13:03:18.122881  7750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:18.123212  7750 log.cc:824] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:18.123888  7750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: No bootstrap required, opened a new log
I20260928 13:03:18.125204  7750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } }
I20260928 13:03:18.125363  7750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:18.125416  7750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 784e6ebb5c964d03b9d7435e1ef1ca39, State: Initialized, Role: FOLLOWER
I20260928 13:03:18.125561  7750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } }
I20260928 13:03:18.125658  7750 raft_consensus.cc:388] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:18.125698  7750 raft_consensus.cc:482] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:18.125739  7750 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:18.126255  7750 raft_consensus.cc:504] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } }
I20260928 13:03:18.126371  7750 leader_election.cc:302] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 784e6ebb5c964d03b9d7435e1ef1ca39; no voters: 
I20260928 13:03:18.126542  7750 leader_election.cc:288] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:18.126806  7750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:18.126837  7755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:18.126986  7755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [term 1 LEADER]: Becoming Leader. State: Replica: 784e6ebb5c964d03b9d7435e1ef1ca39, State: Running, Role: LEADER
I20260928 13:03:18.127097  7755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } }
I20260928 13:03:18.127504  7757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 784e6ebb5c964d03b9d7435e1ef1ca39. Latest consensus state: current_term: 1 leader_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } } }
I20260928 13:03:18.127612  7757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:18.127771  7756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "784e6ebb5c964d03b9d7435e1ef1ca39" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37561 } } }
I20260928 13:03:18.127826  7764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:18.128376  7764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:18.127851  7756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:18.129803  7764 catalog_manager.cc:1347] Generated new cluster ID: 528c5748da994654acc44b2db09264d1
I20260928 13:03:18.129861  7764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:18.155759  7764 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:18.155952  7764 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:18.165699  7764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: Generated new TSK 0
I20260928 13:03:18.165899  7764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:18.171355  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--builtin_ntp_servers=127.3.6.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 13:03:18.253633  7774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:18.253887  7774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:18.253928  7774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:18.255203  7774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:18.255266  7774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:18.255307  7774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:18.256763  7774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:18.257063  7774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:18.257375  7774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:18.262274  7779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.262284  7780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.262288  7782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.262554  7774 server_base.cc:1034] running on GCE node
I20260928 13:03:18.262748  7774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:18.262985  7774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:18.264173  7774 hybrid_clock.cc:648] HybridClock initialized: now 1790600598264157 us; error 32 us; skew 500 ppm
I20260928 13:03:18.265512  7774 webserver.cc:460] Webserver started at http://127.3.6.1:35537/ using document root <none> and password file <none>
I20260928 13:03:18.265789  7774 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:18.265866  7774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:18.266011  7774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:18.267138  7774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "1f12c51a68718693cbeafc8c5683af88"
server_key_iv: "11d4d09ffa60e104f1f7e540da6d36b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.267541  7774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "1f12c51a68718693cbeafc8c5683af88"
server_key_iv: "11d4d09ffa60e104f1f7e540da6d36b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.268923  7774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:18.269634  7788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.269819  7774 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.269912  7774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "1f12c51a68718693cbeafc8c5683af88"
server_key_iv: "11d4d09ffa60e104f1f7e540da6d36b9"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.269994  7774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:18.273375  7774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:18.273634  7774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:18.273772  7774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:18.273981  7774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:18.274273  7774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:18.274329  7774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.274370  7774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:18.274398  7774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.280251  7774 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:38473
I20260928 13:03:18.280342  7901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:38473 every 8 connection(s)
I20260928 13:03:18.280654  7774 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:18.283779  7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.281389 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:36469 (local address 127.3.6.62:37561)
0928 13:03:18.281455 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.281456 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.281707 (+   251us) server_negotiation.cc:407] Connection header received
0928 13:03:18.282144 (+   437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.282145 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.282152 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.282218 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.283531 (+  1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.283532 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.283532 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.283536 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.283549 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.283553 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.283615 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.283709 (+    94us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.283720 (+    11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:18.283952  7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.281350 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37561 (local address 127.3.6.1:36469)
0928 13:03:18.281524 (+   174us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.281564 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.282048 (+   484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.282289 (+   241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.282293 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.282303 (+    10us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.283368 (+  1065us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.283368 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.283396 (+    28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.283425 (+    29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.283618 (+   193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.283621 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.283623 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.283677 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.283725 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260928 13:03:18.284490  7902 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37561
I20260928 13:03:18.284580  7902 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:18.284693  7902 heartbeater.cc:511] Master 127.3.6.62:37561 requested a full tablet report, sending...
I20260928 13:03:18.285145  7714 ts_manager.cc:194] Registered new tserver with Master: 6c9c47b5f3b8482ebcc46bd0569a8c5d (127.3.6.1:38473)
I20260928 13:03:18.286170  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7774
I20260928 13:03:18.286270  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:18.286455  3096 external_mini_cluster.cc:1428] Setting key 3538ef30425bacb9e1c0d6a67ca985a2
I20260928 13:03:18.287474  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--builtin_ntp_servers=127.3.6.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 13:03:18.369132  7905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:18.369360  7905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:18.369385  7905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:18.370544  7905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:18.370580  7905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:18.370606  7905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:18.372001  7905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:18.372210  7905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:18.372534  7905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:18.378391  7910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.378485  7905 server_base.cc:1034] running on GCE node
W20260928 13:03:18.378382  7911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.378387  7913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.378860  7905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:18.379163  7905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:18.380328  7905 hybrid_clock.cc:648] HybridClock initialized: now 1790600598380311 us; error 35 us; skew 500 ppm
I20260928 13:03:18.381750  7905 webserver.cc:460] Webserver started at http://127.3.6.2:32895/ using document root <none> and password file <none>
I20260928 13:03:18.382028  7905 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:18.382087  7905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:18.382254  7905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:18.383492  7905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "f2182fd7183f444ca31152170e4775f4"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "62e78b8c8cb6b62a5c3f45788d477b5b"
server_key_iv: "f6f4e1160bdba496194bddfd44b8223b"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.383914  7905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "f2182fd7183f444ca31152170e4775f4"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "62e78b8c8cb6b62a5c3f45788d477b5b"
server_key_iv: "f6f4e1160bdba496194bddfd44b8223b"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.385470  7905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:18.386235  7919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.386440  7905 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:18.386539  7905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "f2182fd7183f444ca31152170e4775f4"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "62e78b8c8cb6b62a5c3f45788d477b5b"
server_key_iv: "f6f4e1160bdba496194bddfd44b8223b"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.386616  7905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:18.390349  7905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:18.390635  7905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:18.390786  7905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:18.391050  7905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:18.391392  7905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:18.391428  7905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.391449  7905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:18.391501  7905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.397627  7905 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42585
I20260928 13:03:18.397660  8032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42585 every 8 connection(s)
I20260928 13:03:18.398010  7905 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:18.401021  7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.398750 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:51231 (local address 127.3.6.62:37561)
0928 13:03:18.398806 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.398809 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.399110 (+   301us) server_negotiation.cc:407] Connection header received
0928 13:03:18.399618 (+   508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.399619 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.399624 (+     5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.399685 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.400834 (+  1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.400835 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.400835 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.400839 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.400852 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.400856 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.400902 (+    46us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.400956 (+    54us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.400968 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:18.401260  8035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.398732 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37561 (local address 127.3.6.2:51231)
0928 13:03:18.398926 (+   194us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.398969 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.399530 (+   561us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.399743 (+   213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.399746 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.399754 (+     8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.400674 (+   920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.400675 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.400707 (+    32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.400737 (+    30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.400902 (+   165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.400904 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.400907 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.400958 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.401004 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":104,"threads_started":1}
I20260928 13:03:18.401759  8033 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37561
I20260928 13:03:18.401852  8033 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:18.401980  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 7905
I20260928 13:03:18.402007  8033 heartbeater.cc:511] Master 127.3.6.62:37561 requested a full tablet report, sending...
I20260928 13:03:18.402074  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:18.402266  3096 external_mini_cluster.cc:1428] Setting key 48cda1a6a69c9c0076156f52a76d5171
I20260928 13:03:18.402372  7714 ts_manager.cc:194] Registered new tserver with Master: f2182fd7183f444ca31152170e4775f4 (127.3.6.2:42585)
I20260928 13:03:18.403281  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--builtin_ntp_servers=127.3.6.20:38779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 13:03:18.488299  8036 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:18.488518  8036 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:18.488543  8036 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:18.489727  8036 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:18.489763  8036 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:18.489789  8036 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:18.491264  8036 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8036
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:18.491523  8036 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:18.491837  8036 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:18.496937  8041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.496968  8044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.496955  8042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.497090  8036 server_base.cc:1034] running on GCE node
I20260928 13:03:18.497382  8036 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:18.497651  8036 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:18.498888  8036 hybrid_clock.cc:648] HybridClock initialized: now 1790600598498870 us; error 36 us; skew 500 ppm
I20260928 13:03:18.500430  8036 webserver.cc:460] Webserver started at http://127.3.6.3:34743/ using document root <none> and password file <none>
I20260928 13:03:18.500718  8036 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:18.500800  8036 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:18.500939  8036 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:18.502008  8036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "0245368febb84c8fa729a790c6b736cc"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "d463b0c6794c00ede8ed7beee8857478"
server_key_iv: "22e0b84d24006560c599371a3462fdda"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.502379  8036 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "0245368febb84c8fa729a790c6b736cc"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "d463b0c6794c00ede8ed7beee8857478"
server_key_iv: "22e0b84d24006560c599371a3462fdda"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.503786  8036 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:18.504590  8050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.504777  8036 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:18.504880  8036 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "0245368febb84c8fa729a790c6b736cc"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "d463b0c6794c00ede8ed7beee8857478"
server_key_iv: "22e0b84d24006560c599371a3462fdda"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.504953  8036 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:18.508337  8036 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:18.508589  8036 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:18.508728  8036 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:18.508944  8036 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:18.509239  8036 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:18.509291  8036 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.509330  8036 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:18.509357  8036 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.515260  8036 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:35139
I20260928 13:03:18.515293  8163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:35139 every 8 connection(s)
I20260928 13:03:18.515640  8036 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:18.517918  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8036
I20260928 13:03:18.518002  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:18.518177  3096 external_mini_cluster.cc:1428] Setting key fe499aec53662ac7c2c751c4c2af5e52
I20260928 13:03:18.519060  7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.516419 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:44067 (local address 127.3.6.62:37561)
0928 13:03:18.516484 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.516486 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.516706 (+   220us) server_negotiation.cc:407] Connection header received
0928 13:03:18.517184 (+   478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.517185 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.517189 (+     4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.517253 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.518713 (+  1460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.518714 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.518714 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.518718 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.518752 (+    34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.518757 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.518815 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.518909 (+    94us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.518921 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:03:18.519241  8166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.516388 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37561 (local address 127.3.6.3:44067)
0928 13:03:18.516568 (+   180us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.516608 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.517099 (+   491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.517329 (+   230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.517332 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.517341 (+     9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.518525 (+  1184us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.518525 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.518565 (+    40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.518602 (+    37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.518829 (+   227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.518835 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.518838 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.518914 (+    76us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.518977 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260928 13:03:18.519697  8164 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37561
I20260928 13:03:18.519775  8164 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:18.519963  8164 heartbeater.cc:511] Master 127.3.6.62:37561 requested a full tablet report, sending...
I20260928 13:03:18.520335  7714 ts_manager.cc:194] Registered new tserver with Master: 0245368febb84c8fa729a790c6b736cc (127.3.6.3:35139)
I20260928 13:03:18.529843  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:18.532358  7753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.531254 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36148 (local address 127.3.6.62:37561)
0928 13:03:18.531335 (+    81us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.531337 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.531418 (+    81us) server_negotiation.cc:407] Connection header received
0928 13:03:18.531504 (+    86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.531505 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.531511 (+     6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.531562 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.532121 (+   559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.532123 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.532123 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.532128 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.532141 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.532146 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.532196 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.532261 (+    65us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.532277 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260928 13:03:18.533932  7714 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36148:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:18.535513  7714 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:18.539451  8173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.537967 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:38473 (local address 127.0.0.1:52270)
0928 13:03:18.538111 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.538120 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.538151 (+    31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.538471 (+   320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.538476 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.538484 (+     8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.539035 (+   551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.539035 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.539052 (+    17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.539078 (+    26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.539273 (+   195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.539278 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.539282 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.539361 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.539380 (+    19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":69,"threads_started":1}
I20260928 13:03:18.539469  8177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.538166 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52270 (local address 127.3.6.1:38473)
0928 13:03:18.538307 (+   141us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.538312 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.538324 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:18.538350 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.538352 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.538362 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.538697 (+   335us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.539150 (+   453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.539156 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.539156 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.539160 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.539185 (+    25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.539201 (+    16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.539278 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.539375 (+    97us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.539391 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":76,"threads_started":1}
I20260928 13:03:18.539619  8172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.537720 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42585 (local address 127.0.0.1:36894)
0928 13:03:18.537928 (+   208us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.537967 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.538020 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.538548 (+   528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.538549 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.538552 (+     3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.539200 (+   648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.539200 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.539205 (+     5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.539215 (+    10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.539456 (+   241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.539457 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.539458 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.539510 (+    52us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.539524 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"spinlock_wait_cycles":384,"thread_start_us":93,"threads_started":1}
I20260928 13:03:18.540001  8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.537942 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36894 (local address 127.3.6.2:42585)
0928 13:03:18.538381 (+   439us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.538387 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.538396 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:18.538419 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.538421 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.538430 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.538537 (+   107us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.539295 (+   758us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.539302 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.539302 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.539307 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.539342 (+    35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.539371 (+    29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.539464 (+    93us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.539898 (+   434us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.539914 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":70,"threads_started":1}
I20260928 13:03:18.540015  8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.537720 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:35139 (local address 127.0.0.1:47260)
0928 13:03:18.538103 (+   383us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.538114 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.538176 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.538839 (+   663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.538840 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.538843 (+     3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.539659 (+   816us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.539659 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.539666 (+     7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.539677 (+    11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.539901 (+   224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.539902 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.539902 (+     0us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.539949 (+    47us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.539961 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":17,"thread_start_us":87,"threads_started":1}
I20260928 13:03:18.540089  8174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.537847 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47260 (local address 127.3.6.3:35139)
0928 13:03:18.538133 (+   286us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.538138 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.538168 (+    30us) server_negotiation.cc:407] Connection header received
0928 13:03:18.538276 (+   108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.538281 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.538292 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.538364 (+    72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.539764 (+  1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.539772 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.539772 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.539776 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.539806 (+    30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.539827 (+    21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.539878 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.539965 (+    87us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.539981 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":91,"threads_started":1}
I20260928 13:03:18.540159  7836 tablet_service.cc:1467] Processing CreateTablet for tablet e173d00ef7434c4693ddfd92c83b568e (DEFAULT_TABLE table=test-table [id=192f1a9d071141959fedbe0941e4484d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:18.540683  7836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173d00ef7434c4693ddfd92c83b568e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:18.541024  7967 tablet_service.cc:1467] Processing CreateTablet for tablet e173d00ef7434c4693ddfd92c83b568e (DEFAULT_TABLE table=test-table [id=192f1a9d071141959fedbe0941e4484d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:18.541318  7967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173d00ef7434c4693ddfd92c83b568e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:18.543635  8178 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: Bootstrap starting.
I20260928 13:03:18.544168  8098 tablet_service.cc:1467] Processing CreateTablet for tablet e173d00ef7434c4693ddfd92c83b568e (DEFAULT_TABLE table=test-table [id=192f1a9d071141959fedbe0941e4484d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:18.544399  8178 tablet_bootstrap.cc:654] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:18.544509  8098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e173d00ef7434c4693ddfd92c83b568e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:18.544725  8178 log.cc:824] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:18.545504  8178 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: No bootstrap required, opened a new log
I20260928 13:03:18.545601  8178 ts_tablet_manager.cc:1397] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:18.547230  8179 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Bootstrap starting.
I20260928 13:03:18.547887  8179 tablet_bootstrap.cc:654] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:18.548044  8181 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Bootstrap starting.
I20260928 13:03:18.548225  8179 log.cc:824] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:18.548667  8181 tablet_bootstrap.cc:654] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:18.548520  8178 raft_consensus.cc:348] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.548738  8178 raft_consensus.cc:374] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:18.548792  8178 raft_consensus.cc:729] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c9c47b5f3b8482ebcc46bd0569a8c5d, State: Initialized, Role: FOLLOWER
I20260928 13:03:18.548921  8178 consensus_queue.cc:260] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.549001  8181 log.cc:824] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:18.549216  8178 ts_tablet_manager.cc:1428] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260928 13:03:18.549361  7902 heartbeater.cc:503] Master 127.3.6.62:37561 was elected leader, sending a full tablet report...
I20260928 13:03:18.549443  8179 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: No bootstrap required, opened a new log
I20260928 13:03:18.549513  8179 ts_tablet_manager.cc:1397] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:18.549760  8181 tablet_bootstrap.cc:492] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: No bootstrap required, opened a new log
I20260928 13:03:18.549834  8181 ts_tablet_manager.cc:1397] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:18.551826  8179 raft_consensus.cc:348] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.551882  8181 raft_consensus.cc:348] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.551985  8179 raft_consensus.cc:374] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:18.551993  8181 raft_consensus.cc:374] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:18.552031  8179 raft_consensus.cc:729] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2182fd7183f444ca31152170e4775f4, State: Initialized, Role: FOLLOWER
I20260928 13:03:18.552055  8181 raft_consensus.cc:729] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0245368febb84c8fa729a790c6b736cc, State: Initialized, Role: FOLLOWER
I20260928 13:03:18.552158  8179 consensus_queue.cc:260] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.552196  8181 consensus_queue.cc:260] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.552454  8181 ts_tablet_manager.cc:1428] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:18.552450  8179 ts_tablet_manager.cc:1428] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:18.552486  8164 heartbeater.cc:503] Master 127.3.6.62:37561 was elected leader, sending a full tablet report...
I20260928 13:03:18.552455  8033 heartbeater.cc:503] Master 127.3.6.62:37561 was elected leader, sending a full tablet report...
W20260928 13:03:18.648634  8034 tablet.cc:2369] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:18.747282  8186 raft_consensus.cc:482] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:18.747413  8186 raft_consensus.cc:504] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.747745  8186 leader_election.cc:288] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2182fd7183f444ca31152170e4775f4 (127.3.6.2:42585), 6c9c47b5f3b8482ebcc46bd0569a8c5d (127.3.6.1:38473)
I20260928 13:03:18.749267  8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.748107 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:57847 (local address 127.3.6.2:42585)
0928 13:03:18.748212 (+   105us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.748214 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.748225 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:18.748265 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.748266 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.748277 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.748365 (+    88us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.749032 (+   667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.749034 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.749034 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.749039 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.749060 (+    21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.749065 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.749128 (+    63us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.749184 (+    56us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.749199 (+    15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260928 13:03:18.749267  8166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.748007 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42585 (local address 127.3.6.3:57847)
0928 13:03:18.748089 (+    82us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.748101 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.748144 (+    43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.748392 (+   248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.748393 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.748396 (+     3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.748933 (+   537us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.748933 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.748940 (+     7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.748950 (+    10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.749124 (+   174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.749125 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.749126 (+     1us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.749187 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.749201 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260928 13:03:18.749538  8177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.748262 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:53871 (local address 127.3.6.1:38473)
0928 13:03:18.748334 (+    72us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.748336 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.748397 (+    61us) server_negotiation.cc:407] Connection header received
0928 13:03:18.748462 (+    65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.748463 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.748468 (+     5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.748536 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.749227 (+   691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.749228 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.749228 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.749233 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.749249 (+    16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.749254 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.749329 (+    75us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.749459 (+   130us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.749478 (+    19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 13:03:18.749533  8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.748136 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:38473 (local address 127.3.6.3:53871)
0928 13:03:18.748327 (+   191us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.748338 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.748391 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.748559 (+   168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.748560 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.748572 (+    12us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:18.749112 (+   540us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:18.749112 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:18.749119 (+     7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:18.749130 (+    11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:18.749326 (+   196us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:18.749327 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:18.749327 (+     0us) client_negotiation.cc:769] Sending connection context
0928 13:03:18.749426 (+    99us) client_negotiation.cc:240] Negotiation successful
0928 13:03:18.749440 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":98,"threads_started":1}
I20260928 13:03:18.749641  7987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173d00ef7434c4693ddfd92c83b568e" candidate_uuid: "0245368febb84c8fa729a790c6b736cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2182fd7183f444ca31152170e4775f4" is_pre_election: true
I20260928 13:03:18.749802  7987 raft_consensus.cc:2454] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0245368febb84c8fa729a790c6b736cc in term 0.
I20260928 13:03:18.750030  8051 leader_election.cc:302] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0245368febb84c8fa729a790c6b736cc, f2182fd7183f444ca31152170e4775f4; no voters: 
I20260928 13:03:18.750159  8186 raft_consensus.cc:2781] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:18.750221  8186 raft_consensus.cc:482] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:18.750272  8186 raft_consensus.cc:3037] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:18.750384  7856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173d00ef7434c4693ddfd92c83b568e" candidate_uuid: "0245368febb84c8fa729a790c6b736cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" is_pre_election: true
I20260928 13:03:18.750526  7856 raft_consensus.cc:2454] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0245368febb84c8fa729a790c6b736cc in term 0.
I20260928 13:03:18.751209  8186 raft_consensus.cc:504] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.751356  8186 leader_election.cc:288] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [CANDIDATE]: Term 1 election: Requested vote from peers f2182fd7183f444ca31152170e4775f4 (127.3.6.2:42585), 6c9c47b5f3b8482ebcc46bd0569a8c5d (127.3.6.1:38473)
I20260928 13:03:18.751535  7856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173d00ef7434c4693ddfd92c83b568e" candidate_uuid: "0245368febb84c8fa729a790c6b736cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d"
I20260928 13:03:18.751547  7987 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e173d00ef7434c4693ddfd92c83b568e" candidate_uuid: "0245368febb84c8fa729a790c6b736cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2182fd7183f444ca31152170e4775f4"
I20260928 13:03:18.751632  7987 raft_consensus.cc:3037] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:18.751636  7856 raft_consensus.cc:3037] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:18.752357  7987 raft_consensus.cc:2454] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0245368febb84c8fa729a790c6b736cc in term 1.
I20260928 13:03:18.752429  7856 raft_consensus.cc:2454] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0245368febb84c8fa729a790c6b736cc in term 1.
I20260928 13:03:18.752526  8051 leader_election.cc:302] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0245368febb84c8fa729a790c6b736cc, f2182fd7183f444ca31152170e4775f4; no voters: 
I20260928 13:03:18.752641  8186 raft_consensus.cc:2781] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:18.752847  8186 raft_consensus.cc:686] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 1 LEADER]: Becoming Leader. State: Replica: 0245368febb84c8fa729a790c6b736cc, State: Running, Role: LEADER
I20260928 13:03:18.753046  8186 consensus_queue.cc:237] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } }
I20260928 13:03:18.754014  7713 catalog_manager.cc:5495] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0245368febb84c8fa729a790c6b736cc (127.3.6.3). New cstate: current_term: 1 leader_uuid: "0245368febb84c8fa729a790c6b736cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0245368febb84c8fa729a790c6b736cc" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 35139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 } health_report { overall_health: UNKNOWN } } }
W20260928 13:03:18.766271  8165 tablet.cc:2369] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:18.766372  8174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.765421 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.3.6.3:35139)
0928 13:03:18.765460 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.765463 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.765479 (+    16us) server_negotiation.cc:407] Connection header received
0928 13:03:18.765511 (+    32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.765512 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.765522 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.765566 (+    44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.766131 (+   565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.766167 (+    36us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.766167 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.766172 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.766188 (+    16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.766193 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.766250 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.766302 (+    52us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.766316 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:03:18.768131  7856 raft_consensus.cc:1261] T e173d00ef7434c4693ddfd92c83b568e P 6c9c47b5f3b8482ebcc46bd0569a8c5d [term 1 FOLLOWER]: Refusing update from remote peer 0245368febb84c8fa729a790c6b736cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:18.768214  7987 raft_consensus.cc:1261] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 1 FOLLOWER]: Refusing update from remote peer 0245368febb84c8fa729a790c6b736cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:18.768512  8186 consensus_queue.cc:1035] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c9c47b5f3b8482ebcc46bd0569a8c5d" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:18.768661  8188 consensus_queue.cc:1035] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2182fd7183f444ca31152170e4775f4" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:18.771312  8193 mvcc.cc:205] Tried to move back new op lower bound from 7334300052551737344 to 7334300052493479936. Current Snapshot: MvccSnapshot[applied={T|T < 7334300052551737344}]
I20260928 13:03:18.771683  8192 mvcc.cc:205] Tried to move back new op lower bound from 7334300052551737344 to 7334300052493479936. Current Snapshot: MvccSnapshot[applied={T|T < 7334300052551737344}]
I20260928 13:03:18.773037  7713 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:18.773126  7713 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:18.773942  7713 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 784e6ebb5c964d03b9d7435e1ef1ca39: Sending DeleteTablet for 3 replicas of tablet e173d00ef7434c4693ddfd92c83b568e
I20260928 13:03:18.774252  8098 tablet_service.cc:1514] Processing DeleteTablet for tablet e173d00ef7434c4693ddfd92c83b568e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:18 UTC) from {username='slave'} at 127.0.0.1:47260
I20260928 13:03:18.774308  7967 tablet_service.cc:1514] Processing DeleteTablet for tablet e173d00ef7434c4693ddfd92c83b568e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:18 UTC) from {username='slave'} at 127.0.0.1:36894
I20260928 13:03:18.774328  7836 tablet_service.cc:1514] Processing DeleteTablet for tablet e173d00ef7434c4693ddfd92c83b568e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:18 UTC) from {username='slave'} at 127.0.0.1:52270
I20260928 13:03:18.774487  8202 tablet_replica.cc:330] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: stopping tablet replica
I20260928 13:03:18.774575  8202 raft_consensus.cc:2229] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:18.774686  8202 raft_consensus.cc:2258] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:18.774852  8201 tablet_replica.cc:330] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: stopping tablet replica
I20260928 13:03:18.774905  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7774
I20260928 13:03:18.774938  8201 raft_consensus.cc:2229] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:18.775771  8201 raft_consensus.cc:2258] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:18.776191  8201 ts_tablet_manager.cc:1905] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:18.776479  8202 ts_tablet_manager.cc:1905] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:18.778282  8201 ts_tablet_manager.cc:1918] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:18.778331  8202 ts_tablet_manager.cc:1918] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:18.778362  8201 log.cc:1196] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/e173d00ef7434c4693ddfd92c83b568e
I20260928 13:03:18.778407  8202 log.cc:1196] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/e173d00ef7434c4693ddfd92c83b568e
I20260928 13:03:18.778635  8201 ts_tablet_manager.cc:1939] T e173d00ef7434c4693ddfd92c83b568e P 0245368febb84c8fa729a790c6b736cc: Deleting consensus metadata
I20260928 13:03:18.778666  8202 ts_tablet_manager.cc:1939] T e173d00ef7434c4693ddfd92c83b568e P f2182fd7183f444ca31152170e4775f4: Deleting consensus metadata
I20260928 13:03:18.779062  7698 catalog_manager.cc:4841] TS f2182fd7183f444ca31152170e4775f4 (127.3.6.2:42585): tablet e173d00ef7434c4693ddfd92c83b568e (table test-table [id=192f1a9d071141959fedbe0941e4484d]) successfully deleted
I20260928 13:03:18.779070  7699 catalog_manager.cc:4841] TS 0245368febb84c8fa729a790c6b736cc (127.3.6.3:35139): tablet e173d00ef7434c4693ddfd92c83b568e (table test-table [id=192f1a9d071141959fedbe0941e4484d]) successfully deleted
W20260928 13:03:18.781219  7698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:38473 (error 108)
I20260928 13:03:18.781719  8176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.781574 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:38473 (local address 127.0.0.1:52282)
0928 13:03:18.781638 (+    64us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.781685 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:38473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 13:03:18.781777  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7905
W20260928 13:03:18.783803  7698 catalog_manager.cc:4584] TS 6c9c47b5f3b8482ebcc46bd0569a8c5d (127.3.6.1:38473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e173d00ef7434c4693ddfd92c83b568e: Network error: Client connection negotiation failed: client connection to 127.3.6.1:38473: connect: Connection refused (error 111)
I20260928 13:03:18.788195  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8036
I20260928 13:03:18.792752  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 7683
2026-09-28T13:03:18Z chronyd exiting
[       OK ] SecurityITest.TestDisableAuthenticationEncryption (804 ms)
[ RUN      ] SecurityITest.TestJwtMiniCluster
I20260928 13:03:18.811944  3096 mini_oidc.cc:152] Starting JWKS server
I20260928 13:03:18.812919  3096 webserver.cc:460] Webserver started at https://127.0.0.1:37137/ using document root <none> and password file <none>
I20260928 13:03:18.812994  3096 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 13:03:18.813143  3096 webserver.cc:460] Webserver started at http://127.0.0.1:35349/ using document root <none> and password file <none>
2026-09-28T13:03:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:18Z Disabled control of system clock
I20260928 13:03:18.820832  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:33135
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:35947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:33135
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37137/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/testchainca.cert with env {}
W20260928 13:03:18.899466  8210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:18.899650  8210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:18.899670  8210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:18.900727  8210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:18.900760  8210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:18.900774  8210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:18.900785  8210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:18.900804  8210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 13:03:18.900817  8210 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 13:03:18.900828  8210 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37137/jwks.json
I20260928 13:03:18.902228  8210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:35947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:33135
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:33135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37137/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:18.902407  8210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:18.902555  8210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:18.907322  8216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:18.907342  8218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.907428  8210 server_base.cc:1034] running on GCE node
W20260928 13:03:18.907317  8215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:18.907819  8210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:18.908120  8210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:18.909279  8210 hybrid_clock.cc:648] HybridClock initialized: now 1790600598909274 us; error 42 us; skew 500 ppm
I20260928 13:03:18.910457  8210 webserver.cc:460] Webserver started at http://127.3.6.62:37891/ using document root <none> and password file <none>
I20260928 13:03:18.910712  8210 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:18.910780  8210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:18.910952  8210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:18.911993  8210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "31ad840553d0497f9eed20bd0f3cea99"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "796680a56b1724c53b89929d4af04524"
server_key_iv: "8c33fdc36281335eb1cf4d8eab2fab30"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.912379  8210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "31ad840553d0497f9eed20bd0f3cea99"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "796680a56b1724c53b89929d4af04524"
server_key_iv: "8c33fdc36281335eb1cf4d8eab2fab30"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.913612  8210 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:18.914321  8224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:18.914494  8210 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:18.914592  8210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "31ad840553d0497f9eed20bd0f3cea99"
format_stamp: "Formatted at 2026-09-28 13:03:18 on dist-test-slave-ddvw"
server_key: "796680a56b1724c53b89929d4af04524"
server_key_iv: "8c33fdc36281335eb1cf4d8eab2fab30"
server_key_version: "encryptionkey@0"
I20260928 13:03:18.914680  8210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:18.928215  8210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:18.928505  8210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:18.928658  8210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:18.932585  8210 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:33135
I20260928 13:03:18.932621  8276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:33135 every 8 connection(s)
I20260928 13:03:18.932964  8210 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:18.933965  8277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:18.934991  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8210
I20260928 13:03:18.935158  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:18.935349  3096 external_mini_cluster.cc:1428] Setting key 534caa8f413d0eef11a3b8b760da6f0e
I20260928 13:03:18.937152  8277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99: Bootstrap starting.
I20260928 13:03:18.937940  8277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:18.938273  8277 log.cc:824] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:18.939079  8277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99: No bootstrap required, opened a new log
I20260928 13:03:18.941612  8277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } }
I20260928 13:03:18.941799  8277 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:18.941836  8277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ad840553d0497f9eed20bd0f3cea99, State: Initialized, Role: FOLLOWER
I20260928 13:03:18.941900  8280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.935893 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.3.6.62:33135)
0928 13:03:18.936083 (+   190us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.936094 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.936131 (+    37us) server_negotiation.cc:407] Connection header received
0928 13:03:18.936831 (+   700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.936841 (+    10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.936932 (+    91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.937100 (+   168us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:18.937279 (+   179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.938783 (+  1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.939660 (+   877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.940343 (+   683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.940495 (+   152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:18.941136 (+   641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:18.941141 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:18.941142 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:18.941396 (+   254us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:18.941438 (+    42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:18.941453 (+    15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:18.941530 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:18.941597 (+    67us) server_negotiation.cc:299] Negotiation successful
0928 13:03:18.941681 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":60,"threads_started":1}
I20260928 13:03:18.942008  8277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } }
I20260928 13:03:18.942097  8277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:18.942121  8277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:18.942157  8277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:18.942929  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:03:18.942946  8277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } }
I20260928 13:03:18.943061  8277 leader_election.cc:302] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31ad840553d0497f9eed20bd0f3cea99; no voters: 
I20260928 13:03:18.943233  8277 leader_election.cc:288] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:18.943290  8282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:18.943444  8282 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [term 1 LEADER]: Becoming Leader. State: Replica: 31ad840553d0497f9eed20bd0f3cea99, State: Running, Role: LEADER
I20260928 13:03:18.943507  8277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:18.943526  8282 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } }
I20260928 13:03:18.943926  8284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31ad840553d0497f9eed20bd0f3cea99. Latest consensus state: current_term: 1 leader_uuid: "31ad840553d0497f9eed20bd0f3cea99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } } }
I20260928 13:03:18.944021  8284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:18.943933  8283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31ad840553d0497f9eed20bd0f3cea99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31ad840553d0497f9eed20bd0f3cea99" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33135 } } }
I20260928 13:03:18.944131  8283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:18.944283  8289 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:18.945019  8289 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:18.946405  8289 catalog_manager.cc:1347] Generated new cluster ID: 5a2880c22036413f80484bb49002af76
I20260928 13:03:18.946460  8289 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:18.973281  8289 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:18.973832  8289 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:18.976006  8289 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31ad840553d0497f9eed20bd0f3cea99: Generated new TSK 0
I20260928 13:03:18.976207  8289 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260928 13:03:19.007277  8307 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260928 13:03:19.007392  8307 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260928 13:03:19.007982  8306 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:18.991996 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:33135 (local address 127.0.0.1:59264)
0928 13:03:18.992180 (+   184us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:18.992190 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:18.992247 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:18.992445 (+   198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:18.992445 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:18.992447 (+     2us) client_negotiation.cc:189] Negotiated authn=JWT
0928 13:03:18.992512 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:18.992513 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.993469 (+   956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.993469 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:18.994046 (+   577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:18.994047 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.994539 (+   492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.994542 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:18.994601 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:18.994617 (+    16us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 13:03:19.007553 (+ 12936us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0928 13:03:19.007668 (+   115us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.6.62:33135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":97,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.3.6.62:33135: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260928 13:03:19.008262  8280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:18.992067 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59264 (local address 127.3.6.62:33135)
0928 13:03:18.992120 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:18.992123 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:18.992256 (+   133us) server_negotiation.cc:407] Connection header received
0928 13:03:18.992336 (+    80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:18.992337 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:18.992349 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:18.992434 (+    85us) server_negotiation.cc:226] Negotiated authn=JWT
0928 13:03:18.992584 (+   150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.993368 (+   784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.994140 (+   772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:18.994463 (+   323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:18.994533 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:18.994735 (+   202us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 13:03:19.007404 (+ 12669us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0928 13:03:19.008200 (+   796us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59264: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260928 13:03:19.008313  8280 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59264: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37137/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
I20260928 13:03:19.008315  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8210
2026-09-28T13:03:19Z chronyd exiting
I20260928 13:03:19.043949  3096 test_util.cc:175] -----------------------------------------------
I20260928 13:03:19.044078  3096 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790600576430005-3096-0
[  FAILED  ] SecurityITest.TestJwtMiniCluster (233 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260928 13:03:19.044955  3096 mini_oidc.cc:152] Starting JWKS server
I20260928 13:03:19.045706  3096 webserver.cc:460] Webserver started at https://127.0.0.1:44113/ using document root <none> and password file <none>
I20260928 13:03:19.045780  3096 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 13:03:19.045982  3096 webserver.cc:460] Webserver started at http://127.0.0.1:33323/ using document root <none> and password file <none>
2026-09-28T13:03:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:19Z Disabled control of system clock
I20260928 13:03:19.053679  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:46111
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:42121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:46111
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44113/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/testchainca.cert with env {}
W20260928 13:03:19.134925  8313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:19.135223  8313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:19.135272  8313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:19.136521  8313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:19.136590  8313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:19.136610  8313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:19.136631  8313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:19.136667  8313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 13:03:19.136713  8313 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 13:03:19.136734  8313 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44113/jwks.json
I20260928 13:03:19.138379  8313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:46111
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:46111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44113/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:19.138695  8313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:19.138944  8313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:19.144482  8319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:19.144522  8313 server_base.cc:1034] running on GCE node
W20260928 13:03:19.144465  8318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:19.144465  8321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:19.144944  8313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:19.145282  8313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:19.146437  8313 hybrid_clock.cc:648] HybridClock initialized: now 1790600599146427 us; error 51 us; skew 500 ppm
I20260928 13:03:19.147795  8313 webserver.cc:460] Webserver started at http://127.3.6.62:38349/ using document root <none> and password file <none>
I20260928 13:03:19.148057  8313 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:19.148128  8313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:19.148289  8313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:19.149379  8313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "e7e17602fbc749f28edd445a7f625207"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "042c6884e5681924273db925e854f606"
server_key_iv: "0c1033ae182bef9197da286064656025"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.149768  8313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "e7e17602fbc749f28edd445a7f625207"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "042c6884e5681924273db925e854f606"
server_key_iv: "0c1033ae182bef9197da286064656025"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.151150  8313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:19.151885  8327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:19.152061  8313 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:19.152169  8313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "e7e17602fbc749f28edd445a7f625207"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "042c6884e5681924273db925e854f606"
server_key_iv: "0c1033ae182bef9197da286064656025"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.152251  8313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:19.174244  8313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:19.174597  8313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:19.174757  8313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:19.178732  8313 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:46111
I20260928 13:03:19.178779  8379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:46111 every 8 connection(s)
I20260928 13:03:19.179212  8313 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:19.180212  8380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:19.182479  8380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207: Bootstrap starting.
I20260928 13:03:19.183096  8380 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:19.183388  8380 log.cc:824] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:19.184113  8380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207: No bootstrap required, opened a new log
I20260928 13:03:19.185756  8380 raft_consensus.cc:348] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } }
I20260928 13:03:19.185897  8380 raft_consensus.cc:374] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:19.185921  8380 raft_consensus.cc:729] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7e17602fbc749f28edd445a7f625207, State: Initialized, Role: FOLLOWER
I20260928 13:03:19.186089  8380 consensus_queue.cc:260] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } }
I20260928 13:03:19.186153  8380 raft_consensus.cc:388] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:19.186174  8380 raft_consensus.cc:482] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:19.186208  8380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:19.186748  8380 raft_consensus.cc:504] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } }
I20260928 13:03:19.186829  8380 leader_election.cc:302] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e7e17602fbc749f28edd445a7f625207; no voters: 
I20260928 13:03:19.187059  8380 leader_election.cc:288] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:19.187129  8383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:19.187299  8383 raft_consensus.cc:686] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [term 1 LEADER]: Becoming Leader. State: Replica: e7e17602fbc749f28edd445a7f625207, State: Running, Role: LEADER
I20260928 13:03:19.187325  8380 sys_catalog.cc:564] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:19.187395  8383 consensus_queue.cc:237] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } }
I20260928 13:03:19.187796  8385 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e7e17602fbc749f28edd445a7f625207. Latest consensus state: current_term: 1 leader_uuid: "e7e17602fbc749f28edd445a7f625207" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } } }
I20260928 13:03:19.187881  8385 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.188108  8391 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:19.188210  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8313
I20260928 13:03:19.188313  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:19.188489  3096 external_mini_cluster.cc:1428] Setting key 2e0642aecf42330e0d17930fc27edc2c
I20260928 13:03:19.188678  8391 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:19.189271  8384 sys_catalog.cc:455] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e7e17602fbc749f28edd445a7f625207" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e7e17602fbc749f28edd445a7f625207" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46111 } } }
I20260928 13:03:19.189352  8384 sys_catalog.cc:458] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.190429  8391 catalog_manager.cc:1347] Generated new cluster ID: d9a1f6efa474410696dc5300e2d4782b
I20260928 13:03:19.190485  8391 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:19.194897  8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.188965 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.3.6.62:46111)
0928 13:03:19.189474 (+   509us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.189484 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.189517 (+    33us) server_negotiation.cc:407] Connection header received
0928 13:03:19.189633 (+   116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.189640 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.189720 (+    80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.189970 (+   250us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:19.190079 (+   109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.191490 (+  1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.192569 (+  1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.193248 (+   679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.193373 (+   125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.194083 (+   710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:19.194087 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:19.194087 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:19.194294 (+   207us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:19.194344 (+    50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:19.194358 (+    14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:19.194427 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:19.194491 (+    64us) server_negotiation.cc:299] Negotiation successful
0928 13:03:19.194678 (+   187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":435,"thread_start_us":76,"threads_started":1}
I20260928 13:03:19.195897  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:03:19.198900  8391 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:19.199433  8391 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:19.203178  8391 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e7e17602fbc749f28edd445a7f625207: Generated new TSK 0
I20260928 13:03:19.203359  8391 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260928 13:03:19.226971  8410 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260928 13:03:19.227087  8410 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260928 13:03:19.227556  8401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.212862 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34102 (local address 127.3.6.62:46111)
0928 13:03:19.212927 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.212929 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.213039 (+   110us) server_negotiation.cc:407] Connection header received
0928 13:03:19.213117 (+    78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.213118 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.213130 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.213227 (+    97us) server_negotiation.cc:226] Negotiated authn=JWT
0928 13:03:19.213367 (+   140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.214107 (+   740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.214920 (+   813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.215218 (+   298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.215305 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.215493 (+   188us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 13:03:19.227303 (+ 11810us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44113/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0928 13:03:19.227477 (+   174us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34102: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44113/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":41}
W20260928 13:03:19.227623  8401 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34102: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44113/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260928 13:03:19.227623  8409 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:19.212796 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:46111 (local address 127.0.0.1:34102)
0928 13:03:19.212962 (+   166us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:19.212984 (+    22us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:19.213052 (+    68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:19.213226 (+   174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:19.213227 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:19.213228 (+     1us) client_negotiation.cc:189] Negotiated authn=JWT
0928 13:03:19.213295 (+    67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.213298 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.214231 (+   933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.214232 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.214832 (+   600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.214834 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.215305 (+   471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.215309 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.215380 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.215385 (+     5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 13:03:19.227422 (+ 12037us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44113/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0928 13:03:19.227532 (+   110us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.6.62:46111: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44113/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
I20260928 13:03:19.228068  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8313
2026-09-28T13:03:19Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (221 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260928 13:03:19.266255  3096 mini_oidc.cc:152] Starting JWKS server
I20260928 13:03:19.267119  3096 webserver.cc:460] Webserver started at https://127.0.0.1:37753/ using document root <none> and password file <none>
I20260928 13:03:19.267182  3096 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 13:03:19.267392  3096 webserver.cc:460] Webserver started at http://127.0.0.1:36117/ using document root <none> and password file <none>
2026-09-28T13:03:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:19Z Disabled control of system clock
I20260928 13:03:19.275617  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45323
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:44161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:45323
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37753/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260928 13:03:19.358289  8416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:19.358500  8416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:19.358521  8416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:19.359752  8416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:19.359797  8416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:19.359809  8416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:19.359822  8416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:19.359833  8416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 13:03:19.359846  8416 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 13:03:19.359858  8416 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37753/jwks.json
I20260928 13:03:19.361181  8416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:44161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:45323
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37753/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:19.361374  8416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:19.361605  8416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:19.366334  8422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:19.366344  8424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:19.366344  8421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:19.366580  8416 server_base.cc:1034] running on GCE node
I20260928 13:03:19.366840  8416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:19.367197  8416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:19.368376  8416 hybrid_clock.cc:648] HybridClock initialized: now 1790600599368358 us; error 30 us; skew 500 ppm
I20260928 13:03:19.369802  8416 webserver.cc:460] Webserver started at http://127.3.6.62:43249/ using document root <none> and password file <none>
I20260928 13:03:19.370077  8416 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:19.370154  8416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:19.370324  8416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:19.371624  8416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "216de65c97f9423cbe368708a6167cb5"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "4517684c4b1b2ad539a55ff12ab3376d"
server_key_iv: "ca6567554a5feb9c2e62a9e2f7ede063"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.372036  8416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "216de65c97f9423cbe368708a6167cb5"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "4517684c4b1b2ad539a55ff12ab3376d"
server_key_iv: "ca6567554a5feb9c2e62a9e2f7ede063"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.373440  8416 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:19.374255  8430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:19.374480  8416 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:19.374593  8416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "216de65c97f9423cbe368708a6167cb5"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "4517684c4b1b2ad539a55ff12ab3376d"
server_key_iv: "ca6567554a5feb9c2e62a9e2f7ede063"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.374670  8416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:19.406414  8416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:19.406769  8416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:19.406929  8416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:19.410887  8416 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:45323
I20260928 13:03:19.410931  8482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:45323 every 8 connection(s)
I20260928 13:03:19.411319  8416 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:19.411998  8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:19.414717  8483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5: Bootstrap starting.
I20260928 13:03:19.415396  8483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:19.415681  8483 log.cc:824] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:19.416339  8483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5: No bootstrap required, opened a new log
I20260928 13:03:19.418138  8483 raft_consensus.cc:348] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } }
I20260928 13:03:19.418290  8483 raft_consensus.cc:374] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:19.418315  8483 raft_consensus.cc:729] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 216de65c97f9423cbe368708a6167cb5, State: Initialized, Role: FOLLOWER
I20260928 13:03:19.418459  8483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } }
I20260928 13:03:19.418550  8483 raft_consensus.cc:388] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:19.418574  8483 raft_consensus.cc:482] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:19.418605  8483 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:19.419152  8483 raft_consensus.cc:504] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } }
I20260928 13:03:19.419247  8483 leader_election.cc:302] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 216de65c97f9423cbe368708a6167cb5; no voters: 
I20260928 13:03:19.419378  8483 leader_election.cc:288] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:19.419456  8486 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:19.419639  8486 raft_consensus.cc:686] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 216de65c97f9423cbe368708a6167cb5, State: Running, Role: LEADER
I20260928 13:03:19.419674  8483 sys_catalog.cc:564] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:19.419740  8486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } }
I20260928 13:03:19.420301  8487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "216de65c97f9423cbe368708a6167cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } } }
I20260928 13:03:19.420393  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8416
I20260928 13:03:19.420490  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:19.420495  8487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.420684  3096 external_mini_cluster.cc:1428] Setting key 6f3d4266613100ff138f75db00991d47
I20260928 13:03:19.420913  8495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:19.420161  8488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 216de65c97f9423cbe368708a6167cb5. Latest consensus state: current_term: 1 leader_uuid: "216de65c97f9423cbe368708a6167cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "216de65c97f9423cbe368708a6167cb5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45323 } } }
I20260928 13:03:19.421264  8488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.421530  8495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:19.423130  8495 catalog_manager.cc:1347] Generated new cluster ID: 8762b8014c4244ca8c0d955292f56057
I20260928 13:03:19.423189  8495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:19.431624  8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.421281 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53388 (local address 127.3.6.62:45323)
0928 13:03:19.427179 (+  5898us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.427188 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.427217 (+    29us) server_negotiation.cc:407] Connection header received
0928 13:03:19.427319 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.427324 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.427377 (+    53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.427528 (+   151us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:19.427819 (+   291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.428694 (+   875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.429507 (+   813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.429942 (+   435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.430087 (+   145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.430852 (+   765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:19.430857 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:19.430857 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:19.431102 (+   245us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:19.431152 (+    50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:19.431165 (+    13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:19.431238 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:19.431320 (+    82us) server_negotiation.cc:299] Negotiation successful
0928 13:03:19.431405 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5817,"thread_start_us":73,"threads_started":1}
I20260928 13:03:19.432543  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:03:19.452860  8495 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:19.453758  8495 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:19.461750  8495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 216de65c97f9423cbe368708a6167cb5: Generated new TSK 0
I20260928 13:03:19.461987  8495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:19.474265  8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.470268 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53402 (local address 127.3.6.62:45323)
0928 13:03:19.470319 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.470321 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.470462 (+   141us) server_negotiation.cc:407] Connection header received
0928 13:03:19.470543 (+    81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.470543 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.470559 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.470631 (+    72us) server_negotiation.cc:226] Negotiated authn=JWT
0928 13:03:19.470799 (+   168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.471411 (+   612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.472717 (+  1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.472918 (+   201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.472971 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.473181 (+   210us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 13:03:19.474097 (+   916us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
  CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
0928 13:03:19.474211 (+   114us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:53402: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
  CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
Metrics: {"server-negotiator.queue_time_us":28}
W20260928 13:03:19.474349  8504 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:53402: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
  CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
W20260928 13:03:19.474428  8512 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:19.470160 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45323 (local address 127.0.0.1:53402)
0928 13:03:19.470376 (+   216us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:19.470389 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:19.470467 (+    78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:19.470650 (+   183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:19.470651 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:19.470654 (+     3us) client_negotiation.cc:189] Negotiated authn=JWT
0928 13:03:19.470723 (+    69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.470726 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.471502 (+   776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.471503 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.472582 (+  1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.472586 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.472999 (+   413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.473003 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.473071 (+    68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.473077 (+     6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 13:03:19.474196 (+  1119us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
  CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
0928 13:03:19.474317 (+   121us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.6.62:45323: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37753/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
  CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":113,"threads_started":1}
I20260928 13:03:19.474664  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8416
E20260928 13:03:19.486853  8513 webserver.cc:533] Webserver: sslize failed: 
E20260928 13:03:19.486953  8513 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-28T13:03:19Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (246 ms)
[ RUN      ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-28T13:03:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:19Z Disabled control of system clock
I20260928 13:03:19.519909  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38425
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:46407
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:38425
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/testchainca.cert with env {}
W20260928 13:03:19.602342  8517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:19.602531  8517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:19.602553  8517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:19.603648  8517 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:19.603683  8517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:19.603696  8517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:19.603708  8517 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:19.603720  8517 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 13:03:19.603732  8517 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 13:03:19.603744  8517 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260928 13:03:19.605139  8517 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:46407
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:38425
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38425
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:19.605335  8517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:19.605491  8517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:19.610283  8522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:19.610337  8523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:19.610349  8525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:19.610508  8517 server_base.cc:1034] running on GCE node
I20260928 13:03:19.610754  8517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:19.611090  8517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:19.612282  8517 hybrid_clock.cc:648] HybridClock initialized: now 1790600599612252 us; error 39 us; skew 500 ppm
I20260928 13:03:19.613559  8517 webserver.cc:460] Webserver started at http://127.3.6.62:34371/ using document root <none> and password file <none>
I20260928 13:03:19.613819  8517 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:19.613864  8517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:19.613950  8517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:19.614944  8517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "68d0d69d9eac491ba8626bd89eb64537"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "d91a5f3e5e990937ae12eee0e1cef3b8"
server_key_iv: "7baacff8b1b4919be11b0a33c66588de"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.615342  8517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "68d0d69d9eac491ba8626bd89eb64537"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "d91a5f3e5e990937ae12eee0e1cef3b8"
server_key_iv: "7baacff8b1b4919be11b0a33c66588de"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.616575  8517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:19.617242  8531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:19.617393  8517 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:19.617482  8517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "68d0d69d9eac491ba8626bd89eb64537"
format_stamp: "Formatted at 2026-09-28 13:03:19 on dist-test-slave-ddvw"
server_key: "d91a5f3e5e990937ae12eee0e1cef3b8"
server_key_iv: "7baacff8b1b4919be11b0a33c66588de"
server_key_version: "encryptionkey@0"
I20260928 13:03:19.617534  8517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:19.632032  8517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:19.632306  8517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:19.632411  8517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:19.636164  8517 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:38425
I20260928 13:03:19.636237  8583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:38425 every 8 connection(s)
I20260928 13:03:19.636572  8517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:19.637539  8584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:19.639880  8584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537: Bootstrap starting.
I20260928 13:03:19.640466  8584 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:19.640753  8584 log.cc:824] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:19.641422  8584 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537: No bootstrap required, opened a new log
I20260928 13:03:19.643031  8584 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } }
I20260928 13:03:19.643199  8584 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:19.643249  8584 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68d0d69d9eac491ba8626bd89eb64537, State: Initialized, Role: FOLLOWER
I20260928 13:03:19.643400  8584 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } }
I20260928 13:03:19.643482  8584 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:19.643520  8584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:19.643569  8584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:19.644140  8584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } }
I20260928 13:03:19.644169  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8517
I20260928 13:03:19.644280  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:19.644261  8584 leader_election.cc:302] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68d0d69d9eac491ba8626bd89eb64537; no voters: 
I20260928 13:03:19.644464  8584 leader_election.cc:288] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:19.644490  3096 external_mini_cluster.cc:1428] Setting key f330751474b3231d8438c4cacbe4d992
I20260928 13:03:19.644493  8587 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:19.644604  8587 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [term 1 LEADER]: Becoming Leader. State: Replica: 68d0d69d9eac491ba8626bd89eb64537, State: Running, Role: LEADER
I20260928 13:03:19.644711  8587 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } }
I20260928 13:03:19.644739  8584 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:19.645076  8588 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68d0d69d9eac491ba8626bd89eb64537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } } }
I20260928 13:03:19.645277  8588 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.645193  8589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68d0d69d9eac491ba8626bd89eb64537. Latest consensus state: current_term: 1 leader_uuid: "68d0d69d9eac491ba8626bd89eb64537" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68d0d69d9eac491ba8626bd89eb64537" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38425 } } }
I20260928 13:03:19.645506  8589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:19.646344  8598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:19.646847  8598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:19.648350  8598 catalog_manager.cc:1347] Generated new cluster ID: 1abf246b41a944baa97ce31d409f406e
I20260928 13:03:19.648396  8598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:19.650873  8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.644958 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.3.6.62:38425)
0928 13:03:19.645349 (+   391us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.645359 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.645399 (+    40us) server_negotiation.cc:407] Connection header received
0928 13:03:19.645526 (+   127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.645534 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.645605 (+    71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.645794 (+   189us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:19.645999 (+   205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.647776 (+  1777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.648783 (+  1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.649385 (+   602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.649509 (+   124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.650177 (+   668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:19.650181 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:19.650181 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:19.650388 (+   207us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:19.650429 (+    41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:19.650443 (+    14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:19.650514 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:19.650581 (+    67us) server_negotiation.cc:299] Negotiation successful
0928 13:03:19.650656 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":75,"threads_started":1}
I20260928 13:03:19.651785  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:03:19.658787  8598 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:19.659513  8598 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:19.665091  8598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68d0d69d9eac491ba8626bd89eb64537: Generated new TSK 0
I20260928 13:03:19.665294  8598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:19.737393  8592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:19.672250 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58402 (local address 127.3.6.62:38425)
0928 13:03:19.672319 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:19.672327 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:19.672454 (+   127us) server_negotiation.cc:407] Connection header received
0928 13:03:19.672518 (+    64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:19.672519 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:19.672532 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:19.672605 (+    73us) server_negotiation.cc:226] Negotiated authn=JWT
0928 13:03:19.672712 (+   107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.673487 (+   775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.674535 (+  1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.674868 (+   333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.674939 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.675134 (+   195us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 13:03:19.737074 (+ 61940us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0928 13:03:19.737310 (+   236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:58402: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":41}
W20260928 13:03:19.737484  8592 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:58402: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260928 13:03:19.737522  8613 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:19.672177 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38425 (local address 127.0.0.1:58402)
0928 13:03:19.672383 (+   206us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:19.672392 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:19.672445 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:19.672608 (+   163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:19.672609 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:19.672611 (+     2us) client_negotiation.cc:189] Negotiated authn=JWT
0928 13:03:19.672666 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.672668 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.673867 (+  1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.673868 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.674452 (+   584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:19.674453 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:19.674943 (+   490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:19.674946 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:19.674985 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:19.674990 (+     5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 13:03:19.737266 (+ 62276us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0928 13:03:19.737403 (+   137us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.3.6.62:38425: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":109,"threads_started":1}
I20260928 13:03:19.738101  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8517
2026-09-28T13:03:19Z chronyd exiting
[       OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (242 ms)
[ RUN      ] SecurityITest.TestWorldReadableKeytab
[       OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN      ] SecurityITest.TestWorldReadablePrivateKey
[       OK ] SecurityITest.TestWorldReadablePrivateKey (88 ms)
[ RUN      ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:19 dist-test-slave-ddvw krb5kdc[8625](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:19 dist-test-slave-ddvw krb5kdc[8625](info): set up 2 sockets
Sep 28 13:03:19 dist-test-slave-ddvw krb5kdc[8625](info): commencing operation
krb5kdc: starting...
W20260928 13:03:20.960254  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.028s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:21.081434  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42571
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:21.160902  8638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:21.161116  8638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:21.161139  8638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:21.162338  8638 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:21.162386  8638 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:21.162400  8638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:21.162412  8638 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:21.162425  8638 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:21.164034  8638 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8638
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:21.164304  8638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:21.164572  8638 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:21.169476  8638 server_base.cc:1034] running on GCE node
W20260928 13:03:21.169431  8644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.169446  8643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.169479  8646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:21.169898  8638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:21.170202  8638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:21.171370  8638 hybrid_clock.cc:648] HybridClock initialized: now 1790600601171353 us; error 29 us; skew 500 ppm
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.173857  8638 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:21.174245  8638 webserver.cc:460] Webserver started at http://127.3.6.62:37995/ using document root <none> and password file <none>
I20260928 13:03:21.174431  8638 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:21.174472  8638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:21.174558  8638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:21.175683  8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "ad7cdf70639d40e0b705100b2371f9b4"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "d91a77db50c3f0e102bdb7637932d337"
server_key_iv: "1d914755c5ce20768de338c6bbe7479c"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.175998  8638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "ad7cdf70639d40e0b705100b2371f9b4"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "d91a77db50c3f0e102bdb7637932d337"
server_key_iv: "1d914755c5ce20768de338c6bbe7479c"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.177233  8638 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:21.177924  8653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.178089  8638 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:21.178171  8638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "ad7cdf70639d40e0b705100b2371f9b4"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "d91a77db50c3f0e102bdb7637932d337"
server_key_iv: "1d914755c5ce20768de338c6bbe7479c"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.178225  8638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:21.192098  8638 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:21.194489  8638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:21.194605  8638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:21.198438  8638 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42571
I20260928 13:03:21.198499  8705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42571 every 8 connection(s)
I20260928 13:03:21.198839  8638 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:21.199750  8706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:21.202046  8706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: Bootstrap starting.
I20260928 13:03:21.202616  8706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:21.202913  8706 log.cc:824] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:21.203687  8706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: No bootstrap required, opened a new log
I20260928 13:03:21.205322  8706 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } }
I20260928 13:03:21.205495  8706 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:21.205540  8706 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad7cdf70639d40e0b705100b2371f9b4, State: Initialized, Role: FOLLOWER
I20260928 13:03:21.205765  8706 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } }
I20260928 13:03:21.205878  8706 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:21.205942  8706 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:21.205993  8706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:21.206209  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8638
I20260928 13:03:21.206336  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:21.206521  3096 external_mini_cluster.cc:1428] Setting key f3305df17ae9dacb28979d495318f91d
I20260928 13:03:21.206681  8706 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } }
I20260928 13:03:21.206804  8706 leader_election.cc:302] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad7cdf70639d40e0b705100b2371f9b4; no voters: 
I20260928 13:03:21.207032  8706 leader_election.cc:288] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:21.207255  8709 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:21.207300  8706 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:21.207412  8709 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [term 1 LEADER]: Becoming Leader. State: Replica: ad7cdf70639d40e0b705100b2371f9b4, State: Running, Role: LEADER
I20260928 13:03:21.207504  8709 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } }
I20260928 13:03:21.208611  8713 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad7cdf70639d40e0b705100b2371f9b4. Latest consensus state: current_term: 1 leader_uuid: "ad7cdf70639d40e0b705100b2371f9b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } } }
I20260928 13:03:21.208719  8713 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:21.208684  8712 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad7cdf70639d40e0b705100b2371f9b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad7cdf70639d40e0b705100b2371f9b4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42571 } } }
I20260928 13:03:21.209079  8712 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4 [sys.catalog]: This master's current role is: LEADER
W20260928 13:03:21.209254  8726 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:21.209306  8726 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:21.209358  8727 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:21.209496  8727 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:21.211077  8727 catalog_manager.cc:1347] Generated new cluster ID: 58efab495a5b48859030c5558e554bec
I20260928 13:03:21.211131  8727 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:21.218124  8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.207046 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.3.6.62:42571)
0928 13:03:21.207245 (+   199us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.207257 (+    12us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.207469 (+   212us) server_negotiation.cc:407] Connection header received
0928 13:03:21.207771 (+   302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.207780 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.207840 (+    60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.208804 (+   964us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.208918 (+   114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.210247 (+  1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.211339 (+  1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.211765 (+   426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.211882 (+   117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.214197 (+  2315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.214201 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.214201 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.214214 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.216518 (+  2304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.216961 (+   443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.216964 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.216965 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.217056 (+    91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.217267 (+   211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.217268 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.217268 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.217512 (+   244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.217691 (+   179us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.217770 (+    79us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.217927 (+   157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":95,"threads_started":1}
I20260928 13:03:21.240249  8727 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:21.241012  8727 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:21.248324  8727 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad7cdf70639d40e0b705100b2371f9b4: Generated new TSK 0
I20260928 13:03:21.248548  8727 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:21.273864  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:21.355338  8732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:21.355618  8732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:21.355664  8732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:21.356912  8732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:21.356985  8732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:21.357030  8732 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:21.358696  8732 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:21.358973  8732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:21.359244  8732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:21.364311  8737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.364302  8738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.364302  8740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:21.364449  8732 server_base.cc:1034] running on GCE node
I20260928 13:03:21.364791  8732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:21.365067  8732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:21.366236  8732 hybrid_clock.cc:648] HybridClock initialized: now 1790600601366234 us; error 45 us; skew 500 ppm
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.368942  8732 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:21.369441  8732 webserver.cc:460] Webserver started at http://127.3.6.1:45019/ using document root <none> and password file <none>
I20260928 13:03:21.369649  8732 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:21.369690  8732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:21.369781  8732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:21.370826  8732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "8adb42e6fe8043f9bbc762e532b22a51"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "7899d982342eb2178f0654f7428dad21"
server_key_iv: "1830a56e918c7b257098ecf76cf26653"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.371248  8732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "8adb42e6fe8043f9bbc762e532b22a51"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "7899d982342eb2178f0654f7428dad21"
server_key_iv: "1830a56e918c7b257098ecf76cf26653"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.372555  8732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:21.373263  8747 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.373441  8732 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:21.373528  8732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "8adb42e6fe8043f9bbc762e532b22a51"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "7899d982342eb2178f0654f7428dad21"
server_key_iv: "1830a56e918c7b257098ecf76cf26653"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.373584  8732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:21.384989  8732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:21.386799  8732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:21.386917  8732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:21.387173  8732 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:21.387455  8732 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:21.387487  8732 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.387509  8732 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:21.387522  8732 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.393013  8732 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:40669
I20260928 13:03:21.393111  8860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:40669 every 8 connection(s)
I20260928 13:03:21.393414  8732 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:21.398850  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8732
I20260928 13:03:21.398952  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:21.399163  3096 external_mini_cluster.cc:1428] Setting key 52b3f3a81e04983da52c7edd68a7870b
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:21.403451  8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.394177 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:57131 (local address 127.3.6.62:42571)
0928 13:03:21.394225 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.394227 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.394448 (+   221us) server_negotiation.cc:407] Connection header received
0928 13:03:21.395524 (+  1076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.395526 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.395537 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.395589 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.396225 (+   636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.396724 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.397726 (+  1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.397934 (+   208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.398018 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.400466 (+  2448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.400468 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.400468 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.400478 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.401986 (+  1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.402433 (+   447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.402434 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.402435 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.402499 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.402755 (+   256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.402756 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.402757 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.402875 (+   118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.402954 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.403276 (+   322us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.403360 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:21.403650  8863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.394152 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42571 (local address 127.3.6.1:57131)
0928 13:03:21.394326 (+   174us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:21.394362 (+    36us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:21.395413 (+  1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:21.395668 (+   255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:21.395671 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:21.395942 (+   271us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:21.396124 (+   182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.396128 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.396825 (+   697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.396826 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.397633 (+   807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.397635 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.398016 (+   381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.398028 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.398151 (+   123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.398641 (+   490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:21.398667 (+    26us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:21.400379 (+  1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:21.402066 (+  1687us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.402071 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.402073 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.402332 (+   259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.402568 (+   236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.402568 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.402569 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.402681 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.402944 (+   263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:21.402950 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:21.403125 (+   175us) client_negotiation.cc:769] Sending connection context
0928 13:03:21.403252 (+   127us) client_negotiation.cc:240] Negotiation successful
0928 13:03:21.403409 (+   157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
I20260928 13:03:21.404279  8861 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42571
I20260928 13:03:21.404397  8861 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:21.404609  8861 heartbeater.cc:511] Master 127.3.6.62:42571 requested a full tablet report, sending...
I20260928 13:03:21.405193  8670 ts_manager.cc:194] Registered new tserver with Master: 8adb42e6fe8043f9bbc762e532b22a51 (127.3.6.1:40669)
I20260928 13:03:21.406114  8670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:57131
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:21.424126  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:21.515682  8866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:21.515986  8866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:21.516034  8866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:21.517563  8866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:21.517639  8866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:21.517688  8866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:21.520364  8866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:21.520684  8866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:21.520982  8866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:21.526623  8874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.526667  8872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.526851  8871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:21.528085  8866 server_base.cc:1034] running on GCE node
I20260928 13:03:21.528337  8866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:21.528666  8866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:21.529845  8866 hybrid_clock.cc:648] HybridClock initialized: now 1790600601529832 us; error 29 us; skew 500 ppm
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.533252  8866 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:21.533856  8866 webserver.cc:460] Webserver started at http://127.3.6.2:37779/ using document root <none> and password file <none>
I20260928 13:03:21.534154  8866 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:21.534229  8866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:21.534394  8866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:21.536041  8866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "5741073fc4084e74ab61e2f6ad40f12f"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "9b2b5866e494e8395b0b07578a7d679e"
server_key_iv: "36a4bf8817abd44ef2af52fe584b2b5d"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.536506  8866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "5741073fc4084e74ab61e2f6ad40f12f"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "9b2b5866e494e8395b0b07578a7d679e"
server_key_iv: "36a4bf8817abd44ef2af52fe584b2b5d"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.538455  8866 fs_manager.cc:691] Time spent creating directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:21.539556  8881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.539758  8866 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:03:21.539857  8866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "5741073fc4084e74ab61e2f6ad40f12f"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "9b2b5866e494e8395b0b07578a7d679e"
server_key_iv: "36a4bf8817abd44ef2af52fe584b2b5d"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.539944  8866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:21.577190  8866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:21.579226  8866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:21.579344  8866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:21.579540  8866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:21.579864  8866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:21.579896  8866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.579952  8866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:21.579988  8866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.585978  8866 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:34361
I20260928 13:03:21.586022  8994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:34361 every 8 connection(s)
I20260928 13:03:21.586370  8866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:21.589529  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 8866
I20260928 13:03:21.589624  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:21.589803  3096 external_mini_cluster.cc:1428] Setting key b101724ccebec21371212d7da0574db4
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:21.596846  8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.587141 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:50469 (local address 127.3.6.62:42571)
0928 13:03:21.587187 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.587189 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.587400 (+   211us) server_negotiation.cc:407] Connection header received
0928 13:03:21.588388 (+   988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.588390 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.588401 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.588462 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.589078 (+   616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.589780 (+   702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.591090 (+  1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.591408 (+   318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.591482 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.593865 (+  2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.593866 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.593867 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.593874 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.595378 (+  1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.595888 (+   510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.595889 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.595890 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.595940 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.596231 (+   291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.596231 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.596232 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.596328 (+    96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.596377 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.596713 (+   336us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.596783 (+    70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:21.597139  8997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.587134 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42571 (local address 127.3.6.2:50469)
0928 13:03:21.587286 (+   152us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:21.587324 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:21.588278 (+   954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:21.588530 (+   252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:21.588534 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:21.588800 (+   266us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:21.589007 (+   207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.589011 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.589981 (+   970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.589982 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.590966 (+   984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.590968 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.591481 (+   513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.591490 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.591596 (+   106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.592187 (+   591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:21.592196 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:21.593764 (+  1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:21.595457 (+  1693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.595463 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.595466 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.595805 (+   339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.596009 (+   204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.596010 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.596010 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.596163 (+   153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.596391 (+   228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:21.596398 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:21.596572 (+   174us) client_negotiation.cc:769] Sending connection context
0928 13:03:21.596697 (+   125us) client_negotiation.cc:240] Negotiation successful
0928 13:03:21.596876 (+   179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":90,"threads_started":1}
I20260928 13:03:21.597698  8995 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42571
I20260928 13:03:21.597798  8995 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:21.597992  8995 heartbeater.cc:511] Master 127.3.6.62:42571 requested a full tablet report, sending...
I20260928 13:03:21.598366  8670 ts_manager.cc:194] Registered new tserver with Master: 5741073fc4084e74ab61e2f6ad40f12f (127.3.6.2:34361)
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:03:21.598688  8670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:50469
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:21.617493  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:37735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:21.698048  9000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:21.698284  9000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:21.698321  9000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:21.699540  9000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:21.699600  9000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:21.699646  9000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:21.701102  9000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:42571
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:21.701355  9000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:21.701578  9000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:21.706420  9005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.706501  9006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:21.706416  9008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:21.706507  9000 server_base.cc:1034] running on GCE node
I20260928 13:03:21.706946  9000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:21.707207  9000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:21.708385  9000 hybrid_clock.cc:648] HybridClock initialized: now 1790600601708372 us; error 29 us; skew 500 ppm
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.710992  9000 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:21.711489  9000 webserver.cc:460] Webserver started at http://127.3.6.3:46841/ using document root <none> and password file <none>
I20260928 13:03:21.711701  9000 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:21.711743  9000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:21.711831  9000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:21.712812  9000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "def03b6141f9471fa04991b9444584e9"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "b12f9ef8dbedefe132af0d8c4191cacf"
server_key_iv: "bad844b97a52e07043230ddbdcf50cbd"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.713099  9000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "def03b6141f9471fa04991b9444584e9"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "b12f9ef8dbedefe132af0d8c4191cacf"
server_key_iv: "bad844b97a52e07043230ddbdcf50cbd"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.714303  9000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:03:21.715097  9015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.715274  9000 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:21.715354  9000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "def03b6141f9471fa04991b9444584e9"
format_stamp: "Formatted at 2026-09-28 13:03:21 on dist-test-slave-ddvw"
server_key: "b12f9ef8dbedefe132af0d8c4191cacf"
server_key_iv: "bad844b97a52e07043230ddbdcf50cbd"
server_key_version: "encryptionkey@0"
I20260928 13:03:21.715406  9000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:21.727499  9000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:21.729722  9000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:21.729836  9000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:21.730015  9000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:21.730317  9000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:21.730355  9000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.730378  9000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:21.730391  9000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:21.736054  9000 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:43295
I20260928 13:03:21.736138  9128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:43295 every 8 connection(s)
I20260928 13:03:21.736445  9000 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:21.742010  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9000
I20260928 13:03:21.742079  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:21.742264  3096 external_mini_cluster.cc:1428] Setting key 9b05b4d2f1c7c5cb188527a66bbbe0e5
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:21.745805  8711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.737238 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:59299 (local address 127.3.6.62:42571)
0928 13:03:21.737329 (+    91us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.737331 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.737440 (+   109us) server_negotiation.cc:407] Connection header received
0928 13:03:21.738383 (+   943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.738384 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.738394 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.738446 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.739052 (+   606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.739548 (+   496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.740519 (+   971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.740692 (+   173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.740743 (+    51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.743174 (+  2431us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.743176 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.743176 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.743183 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.744446 (+  1263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.744869 (+   423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.744870 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.744871 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.744935 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.745179 (+   244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.745180 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.745181 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.745296 (+   115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.745371 (+    75us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.745636 (+   265us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.745713 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260928 13:03:21.746007  9131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.737145 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42571 (local address 127.3.6.3:59299)
0928 13:03:21.737302 (+   157us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:21.737349 (+    47us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:21.738290 (+   941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:21.738503 (+   213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:21.738506 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:21.738751 (+   245us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:21.738950 (+   199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.738954 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.739623 (+   669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.739624 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.740445 (+   821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:21.740447 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.740754 (+   307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.740762 (+     8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:21.740882 (+   120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.741390 (+   508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:21.741398 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:21.743080 (+  1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:21.744543 (+  1463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.744549 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.744551 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.744768 (+   217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.745000 (+   232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:21.745001 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:21.745001 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:21.745112 (+   111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:21.745362 (+   250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:21.745368 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:21.745508 (+   140us) client_negotiation.cc:769] Sending connection context
0928 13:03:21.745615 (+   107us) client_negotiation.cc:240] Negotiation successful
0928 13:03:21.745769 (+   154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260928 13:03:21.746517  9129 heartbeater.cc:347] Connected to a master server at 127.3.6.62:42571
I20260928 13:03:21.746596  9129 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:21.746729  9129 heartbeater.cc:511] Master 127.3.6.62:42571 requested a full tablet report, sending...
I20260928 13:03:21.747188  8670 ts_manager.cc:194] Registered new tserver with Master: def03b6141f9471fa04991b9444584e9 (127.3.6.3:43295)
I20260928 13:03:21.747567  8670 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:59299
I20260928 13:03:21.754235  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/test-admin.keytab.
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.770746  3096 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260928 13:03:21.772519  9136 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:21.771696 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.3.6.1:40669)
0928 13:03:21.771880 (+   184us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.771885 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.771894 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:21.771919 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.771921 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.771934 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.772018 (+    84us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.772415 (+   397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37316: BlockingRecv error: recv got EOF from 127.0.0.1:37316 (error 108)
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":76,"threads_started":1}
W20260928 13:03:21.772643  3096 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc' of type FILE
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.773665  3096 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.774588  3096 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:21.782915  9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.775124 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37322 (local address 127.3.6.1:40669)
0928 13:03:21.775174 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.775176 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.775315 (+   139us) server_negotiation.cc:407] Connection header received
0928 13:03:21.775419 (+   104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.775420 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.775431 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.775479 (+    48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.775955 (+   476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.776733 (+   778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.777503 (+   770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.777870 (+   367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.777954 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.780139 (+  2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.780154 (+    15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.780155 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.780161 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.781699 (+  1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.782069 (+   370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.782072 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.782073 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.782126 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.782327 (+   201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.782328 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.782329 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.782482 (+   153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.782658 (+   176us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.782704 (+    46us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.782787 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
W20260928 13:03:21.784916  9136 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:21.784280 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37330 (local address 127.3.6.1:40669)
0928 13:03:21.784336 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.784337 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.784430 (+    93us) server_negotiation.cc:407] Connection header received
0928 13:03:21.784494 (+    64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.784494 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.784505 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.784575 (+    70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.784859 (+   284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37330: BlockingRecv error: recv got EOF from 127.0.0.1:37330 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260928 13:03:21.785084  3096 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc)
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.786187  3096 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.787199  3096 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:21.794399  9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.787803 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.3.6.1:40669)
0928 13:03:21.787899 (+    96us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.787901 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.787910 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:21.787956 (+    46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.787956 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.787966 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.788018 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.788413 (+   395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.789032 (+   619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.789740 (+   708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.789938 (+   198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.790001 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.792067 (+  2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.792068 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.792069 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.792075 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.793358 (+  1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.793671 (+   313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.793672 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.793673 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.793738 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.793918 (+   180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.793918 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.793919 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.794009 (+    90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.794081 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.794162 (+    81us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.794229 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260928 13:03:21.796010  9136 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:21.795530 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37346 (local address 127.3.6.1:40669)
0928 13:03:21.795568 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.795569 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.795603 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:03:21.795654 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.795654 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.795662 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.795713 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.795935 (+   222us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37346: BlockingRecv error: recv got EOF from 127.0.0.1:37346 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 13:03:21.796097  3096 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790600576430005-3096-0/krb5kdc/krb5cc' of type FILE
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.797083  3096 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:21.797924  3096 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[8625](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600601, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:03:21.805226  9136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:21.798455 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37352 (local address 127.3.6.1:40669)
0928 13:03:21.798510 (+    55us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:21.798512 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:21.798569 (+    57us) server_negotiation.cc:407] Connection header received
0928 13:03:21.798610 (+    41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:21.798610 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:21.798619 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:21.798665 (+    46us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:21.799004 (+   339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.799509 (+   505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.800220 (+   711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:21.800398 (+   178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:21.800446 (+    48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:21.802460 (+  2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:21.802462 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:21.802462 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:21.802468 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:21.803965 (+  1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.804313 (+   348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.804313 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.804314 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.804386 (+    72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:21.804554 (+   168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:21.804554 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:21.804555 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:21.804642 (+    87us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:21.804712 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:21.805059 (+   347us) server_negotiation.cc:299] Negotiation successful
0928 13:03:21.805146 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 13:03:21.806079  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8732
I20260928 13:03:21.811100  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8866
I20260928 13:03:21.815383  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9000
I20260928 13:03:21.819420  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 8638
2026-09-28T13:03:21Z chronyd exiting
[       OK ] SecurityITest.TestCorruptKerberosCC (1906 ms)
[ RUN      ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[9149](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[9149](info): set up 2 sockets
Sep 28 13:03:21 dist-test-slave-ddvw krb5kdc[9149](info): commencing operation
krb5kdc: starting...
W20260928 13:03:22.855715  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.016s	user 0.001s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:22 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:22Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab.
Entry for principal oryx/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab.
I20260928 13:03:22.974977  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45131
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab
--principal=oryx/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:45131
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:23.054626  9162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:23.054862  9162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:23.054885  9162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:23.056123  9162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:23.056175  9162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:23.056196  9162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:23.056244  9162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:23.056274  9162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:23.057825  9162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:45131
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab
--principal=oryx/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:45131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:23.058116  9162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:23.058372  9162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:23.063370  9170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.063370  9168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.063403  9167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.063405  9162 server_base.cc:1034] running on GCE node
I20260928 13:03:23.063860  9162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.064169  9162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.065336  9162 hybrid_clock.cc:648] HybridClock initialized: now 1790600603065329 us; error 38 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.071555  9162 init.cc:377] Logged in from keytab as oryx/127.3.6.62@KRBTEST.COM (short username oryx)
I20260928 13:03:23.072016  9162 webserver.cc:460] Webserver started at http://127.3.6.62:40277/ using document root <none> and password file <none>
I20260928 13:03:23.072258  9162 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.072324  9162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.072481  9162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:23.073575  9162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "b1f438ab7d7c4c88a69b8c87e0623799"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "6b4583bc12787497eb84169ed3c73d93"
server_key_iv: "5d120e23b9e58735ea9bf891a518e214"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.073963  9162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "b1f438ab7d7c4c88a69b8c87e0623799"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "6b4583bc12787497eb84169ed3c73d93"
server_key_iv: "5d120e23b9e58735ea9bf891a518e214"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.075387  9162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:23.076200  9177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.076416  9162 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:23.076529  9162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "b1f438ab7d7c4c88a69b8c87e0623799"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "6b4583bc12787497eb84169ed3c73d93"
server_key_iv: "5d120e23b9e58735ea9bf891a518e214"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.076606  9162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.111806  9162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.113858  9162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:23.114027  9162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.118129  9162 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:45131
I20260928 13:03:23.118188  9229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:45131 every 8 connection(s)
I20260928 13:03:23.118552  9162 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:23.119572  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9162
I20260928 13:03:23.119637  9230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:23.119661  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:23.119872  3096 external_mini_cluster.cc:1428] Setting key 416fa99638525ebdc1ae3cb4f9ed17b9
I20260928 13:03:23.123215  9230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Bootstrap starting.
I20260928 13:03:23.123803  9230 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:23.124146  9230 log.cc:824] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:23.124883  9230 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: No bootstrap required, opened a new log
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:23.126756  9230 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } }
I20260928 13:03:23.126907  9230 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:23.126956  9230 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1f438ab7d7c4c88a69b8c87e0623799, State: Initialized, Role: FOLLOWER
I20260928 13:03:23.127134  9230 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } }
I20260928 13:03:23.127247  9230 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:23.127293  9230 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:23.127352  9230 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:23.128008  9230 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } }
I20260928 13:03:23.128119  9230 leader_election.cc:302] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1f438ab7d7c4c88a69b8c87e0623799; no voters: 
I20260928 13:03:23.128332  9230 leader_election.cc:288] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:23.128394  9235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:23.128522  9235 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 LEADER]: Becoming Leader. State: Replica: b1f438ab7d7c4c88a69b8c87e0623799, State: Running, Role: LEADER
I20260928 13:03:23.128609  9230 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:23.128621  9235 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } }
I20260928 13:03:23.129112  9237 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f438ab7d7c4c88a69b8c87e0623799. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } }
I20260928 13:03:23.129251  9237 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:23.129642  9236 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } }
I20260928 13:03:23.129805  9236 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:23.130020  9241 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:23.130544  9241 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:23.131057  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.120381 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45770 (local address 127.3.6.62:45131)
0928 13:03:23.120545 (+   164us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.120556 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.120588 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:03:23.121076 (+   488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.121085 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.121156 (+    71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.121317 (+   161us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.121918 (+   601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.123301 (+  1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.124052 (+   751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.124611 (+   559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.124734 (+   123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.127108 (+  2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.127111 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.127112 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.127121 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.129124 (+  2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.129522 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.129525 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.129526 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.129626 (+   100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.129855 (+   229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.129856 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.129856 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.130290 (+   434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.130549 (+   259us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.130614 (+    65us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.130857 (+   243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":80,"threads_started":1}
I20260928 13:03:23.132375  9241 catalog_manager.cc:1347] Generated new cluster ID: d2537b906a8d44b4b30ad6bfdbcaa5a4
I20260928 13:03:23.132412  9241 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:23.145227  9241 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:23.145783  9241 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:23.152688  9241 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Generated new TSK 0
I20260928 13:03:23.152899  9241 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
I20260928 13:03:23.181488  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:23.263789  9256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:23.264006  9256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:23.264031  9256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:23.265177  9256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:23.265216  9256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:23.265242  9256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:23.266691  9256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:23.266880  9256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:23.267107  9256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:23.271905  9261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.271914  9262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.271932  9264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.272229  9256 server_base.cc:1034] running on GCE node
I20260928 13:03:23.272452  9256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.272679  9256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.273826  9256 hybrid_clock.cc:648] HybridClock initialized: now 1790600603273816 us; error 39 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.276239  9256 init.cc:377] Logged in from keytab as oryx/127.3.6.1@KRBTEST.COM (short username oryx)
I20260928 13:03:23.276678  9256 webserver.cc:460] Webserver started at http://127.3.6.1:42137/ using document root <none> and password file <none>
I20260928 13:03:23.276892  9256 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.276957  9256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.277101  9256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:23.278154  9256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "e7163ccfb1a14dc38e39e321519b11d6"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "50c2c7548079d8bd713519643f8f2bf7"
server_key_iv: "49a01acec07dfa6b0392ac7f83dcf2d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.278524  9256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "e7163ccfb1a14dc38e39e321519b11d6"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "50c2c7548079d8bd713519643f8f2bf7"
server_key_iv: "49a01acec07dfa6b0392ac7f83dcf2d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.279968  9256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:23.280707  9271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.280973  9256 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:23.281068  9256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "e7163ccfb1a14dc38e39e321519b11d6"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "50c2c7548079d8bd713519643f8f2bf7"
server_key_iv: "49a01acec07dfa6b0392ac7f83dcf2d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.281136  9256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.307125  9256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.309080  9256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:23.309238  9256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.309484  9256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:23.309780  9256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:23.309829  9256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.309861  9256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:23.309881  9256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.315627  9256 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:46533
I20260928 13:03:23.315671  9384 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:46533 every 8 connection(s)
I20260928 13:03:23.315986  9256 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:23.316382  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9256
I20260928 13:03:23.316490  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:23.316722  3096 external_mini_cluster.cc:1428] Setting key 7ae8ed7eaa53f2975b1f334e15a501dd
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for oryx/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:03:23.326151  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.316740 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50833 (local address 127.3.6.62:45131)
0928 13:03:23.316784 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.316786 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.317028 (+   242us) server_negotiation.cc:407] Connection header received
0928 13:03:23.317612 (+   584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.317613 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.317625 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.317676 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.318610 (+   934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.319191 (+   581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.320180 (+   989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.320401 (+   221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.320486 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.323067 (+  2581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.323068 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.323069 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.323076 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.324532 (+  1456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.325076 (+   544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.325078 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.325079 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.325139 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.325391 (+   252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.325392 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.325393 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.325555 (+   162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.325624 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.325995 (+   371us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.326081 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:23.326285  9387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.316735 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:50833)
0928 13:03:23.316906 (+   171us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.316955 (+    49us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.317493 (+   538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.317746 (+   253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.317751 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.318315 (+   564us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.318514 (+   199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.318518 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.319277 (+   759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.319278 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.320090 (+   812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.320092 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.320483 (+   391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.320494 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.320617 (+   123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.321179 (+   562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.321188 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.322910 (+  1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.324644 (+  1734us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.324662 (+    18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.324665 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.324986 (+   321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.325206 (+   220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.325207 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.325207 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.325325 (+   118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.325635 (+   310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.325641 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.325840 (+   199us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.325944 (+   104us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.326083 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260928 13:03:23.326916  9385 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.2@KRBTEST.COM" created.
I20260928 13:03:23.327060  9385 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:23.327262  9385 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:23.328085  9194 ts_manager.cc:194] Registered new tserver with Master: e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
I20260928 13:03:23.328948  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:50833
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
I20260928 13:03:23.342370  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:23.422686  9390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:23.422941  9390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:23.422979  9390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:23.424157  9390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:23.424229  9390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:23.424273  9390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:23.425702  9390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:23.425956  9390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:23.426177  9390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:23.431375  9390 server_base.cc:1034] running on GCE node
W20260928 13:03:23.431322  9396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.431322  9398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.431319  9395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.431768  9390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.432006  9390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.433163  9390 hybrid_clock.cc:648] HybridClock initialized: now 1790600603433142 us; error 44 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.435591  9390 init.cc:377] Logged in from keytab as oryx/127.3.6.2@KRBTEST.COM (short username oryx)
I20260928 13:03:23.436019  9390 webserver.cc:460] Webserver started at http://127.3.6.2:38253/ using document root <none> and password file <none>
I20260928 13:03:23.436261  9390 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.436326  9390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.436457  9390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:23.437454  9390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "778b13b0e7b5462a8445b1b50d5db006"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "be24245f5b3d52db57edd6d0d6a6f12e"
server_key_iv: "b491fd09c076b242a07b4ff0e946574e"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.437803  9390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "778b13b0e7b5462a8445b1b50d5db006"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "be24245f5b3d52db57edd6d0d6a6f12e"
server_key_iv: "b491fd09c076b242a07b4ff0e946574e"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.439083  9390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:03:23.439756  9405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.439930  9390 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:23.440018  9390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "778b13b0e7b5462a8445b1b50d5db006"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "be24245f5b3d52db57edd6d0d6a6f12e"
server_key_iv: "b491fd09c076b242a07b4ff0e946574e"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.440095  9390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.483765  9390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.486241  9390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:23.486416  9390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.486671  9390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:23.486994  9390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:23.487066  9390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.487102  9390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:23.487142  9390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.493157  9390 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:43463
I20260928 13:03:23.493201  9518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:43463 every 8 connection(s)
I20260928 13:03:23.493547  9390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:23.497601  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9390
I20260928 13:03:23.497707  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:23.497915  3096 external_mini_cluster.cc:1428] Setting key 940e0e75711778f17dc7fcfafc8cdb04
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:23.504405  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.494376 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:42519 (local address 127.3.6.62:45131)
0928 13:03:23.494437 (+    61us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.494439 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.494659 (+   220us) server_negotiation.cc:407] Connection header received
0928 13:03:23.495243 (+   584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.495245 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.495257 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.495317 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.496327 (+  1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.496849 (+   522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.497989 (+  1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.498250 (+   261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.498326 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.501140 (+  2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.501142 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.501142 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.501156 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.502744 (+  1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.503392 (+   648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.503393 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.503394 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.503456 (+    62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.503717 (+   261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.503718 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.503718 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.503844 (+   126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.503918 (+    74us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.504202 (+   284us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.504293 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:03:23.504621  9521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.494358 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:42519)
0928 13:03:23.494526 (+   168us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.494564 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.495131 (+   567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.495398 (+   267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.495402 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.495996 (+   594us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.496212 (+   216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.496217 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.496948 (+   731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.496949 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.497887 (+   938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.497894 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.498321 (+   427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.498333 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.498463 (+   130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.499121 (+   658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.499134 (+    13us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.501030 (+  1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.503000 (+  1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.503028 (+    28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.503031 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.503293 (+   262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.503522 (+   229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.503523 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.503523 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.503645 (+   122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.503908 (+   263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.503915 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.504069 (+   154us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.504171 (+   102us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.504373 (+   202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260928 13:03:23.505128  9519 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
I20260928 13:03:23.505223  9519 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:23.505429  9519 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:23.505816  9194 ts_manager.cc:194] Registered new tserver with Master: 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463)
WARNING: no policy specified for oryx/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:03:23.506364  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:42519
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
I20260928 13:03:23.523268  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:23.603513  9524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:23.603711  9524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:23.603734  9524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:23.604820  9524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:23.604851  9524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:23.604876  9524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:23.606212  9524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:45131
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:23.606393  9524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:23.606554  9524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:23.611289  9529 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.611289  9530 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.611289  9532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.611547  9524 server_base.cc:1034] running on GCE node
I20260928 13:03:23.611732  9524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.611920  9524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.613060  9524 hybrid_clock.cc:648] HybridClock initialized: now 1790600603613045 us; error 32 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.615656  9524 init.cc:377] Logged in from keytab as oryx/127.3.6.3@KRBTEST.COM (short username oryx)
I20260928 13:03:23.616098  9524 webserver.cc:460] Webserver started at http://127.3.6.3:37403/ using document root <none> and password file <none>
I20260928 13:03:23.616289  9524 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.616329  9524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.616417  9524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:23.617455  9524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "e3bc8937eb3248c3917c221eed0c318b"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "e21ba869679b496b85640999931a694e"
server_key_iv: "8d8ca3054a2ba706c8b7f2f41c8051f4"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.617751  9524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "e3bc8937eb3248c3917c221eed0c318b"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "e21ba869679b496b85640999931a694e"
server_key_iv: "8d8ca3054a2ba706c8b7f2f41c8051f4"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.619082  9524 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:23.619827  9539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.620041  9524 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:23.620136  9524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "e3bc8937eb3248c3917c221eed0c318b"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "e21ba869679b496b85640999931a694e"
server_key_iv: "8d8ca3054a2ba706c8b7f2f41c8051f4"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.620224  9524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.639761  9524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.641728  9524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:23.641876  9524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.642115  9524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:23.642423  9524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:23.642454  9524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.642495  9524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:23.642558  9524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.648346  9524 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:44257
I20260928 13:03:23.648409  9652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:44257 every 8 connection(s)
I20260928 13:03:23.648705  9524 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:23.657804  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.649408 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:48287 (local address 127.3.6.62:45131)
0928 13:03:23.649452 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.649454 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.649669 (+   215us) server_negotiation.cc:407] Connection header received
0928 13:03:23.650198 (+   529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.650200 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.650212 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.650259 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.651244 (+   985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.651745 (+   501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.652815 (+  1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.653009 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.653092 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.655220 (+  2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.655222 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.655222 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.655229 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.656435 (+  1206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.656860 (+   425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.656861 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.656861 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.656921 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.657163 (+   242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.657164 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.657164 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.657278 (+   114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.657350 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.657621 (+   271us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.657710 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:03:23.657986  9655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.649386 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:48287)
0928 13:03:23.649550 (+   164us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.649585 (+    35us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.650091 (+   506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.650328 (+   237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.650332 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.650902 (+   570us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.651114 (+   212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.651118 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.651846 (+   728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.651847 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.652714 (+   867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.652716 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.653089 (+   373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.653100 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.653235 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.653754 (+   519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.653763 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.655110 (+  1347us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.656531 (+  1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.656538 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.656540 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.656773 (+   233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.656985 (+   212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.656986 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.656987 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.657092 (+   105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.657340 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.657346 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.657485 (+   139us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.657589 (+   104us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.657749 (+   160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260928 13:03:23.658036  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9524
I20260928 13:03:23.658119  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:23.658303  3096 external_mini_cluster.cc:1428] Setting key c83182434db16341af4e23b3b9304364
I20260928 13:03:23.658633  9653 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
I20260928 13:03:23.658766  9653 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:23.658958  9653 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:23.659327  9194 ts_manager.cc:194] Registered new tserver with Master: e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:23.659714  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:48287
I20260928 13:03:23.670024  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.6.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.61.keytab.
Entry for principal oryx/127.3.6.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.61.keytab.
I20260928 13:03:23.693897  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:40331
--webserver_interface=127.3.6.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.61.keytab
--principal=oryx/127.3.6.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:45131,127.3.6.61:40331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:23.774159  9658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:23.774430  9658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:23.774471  9658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:23.775686  9658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:23.775758  9658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:23.775780  9658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:23.775801  9658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:23.775830  9658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:23.777284  9658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:45131,127.3.6.61:40331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.61.keytab
--principal=oryx/127.3.6.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:40331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.6.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
W20260928 13:03:23.777431  9658 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.3.6.62:45131,127.3.6.61:40331'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260928 13:03:23.777596  9658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:23.777812  9658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:23.782656  9663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.782687  9664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.782660  9666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.782961  9658 server_base.cc:1034] running on GCE node
I20260928 13:03:23.783234  9658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.783629  9658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.784783  9658 hybrid_clock.cc:648] HybridClock initialized: now 1790600603784774 us; error 67 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.787487  9658 init.cc:377] Logged in from keytab as oryx/127.3.6.61@KRBTEST.COM (short username oryx)
I20260928 13:03:23.788007  9658 webserver.cc:460] Webserver started at http://127.3.6.61:35891/ using document root <none> and password file <none>
I20260928 13:03:23.788232  9658 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.788293  9658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.788429  9658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:23.789486  9658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/instance:
uuid: "92fe38e867f443a5bf1a932ba75cdf15"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "d269de2f681bdbd13ef6112d05c4741c"
server_key_iv: "60a763cd22f0ac87dcecc794153931fb"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.789966  9658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal/instance:
uuid: "92fe38e867f443a5bf1a932ba75cdf15"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "d269de2f681bdbd13ef6112d05c4741c"
server_key_iv: "60a763cd22f0ac87dcecc794153931fb"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.791455  9658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:23.792212  9673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.792402  9658 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:23.792510  9658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "92fe38e867f443a5bf1a932ba75cdf15"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "d269de2f681bdbd13ef6112d05c4741c"
server_key_iv: "60a763cd22f0ac87dcecc794153931fb"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.792587  9658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.806166  9658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.807996  9658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:23.808173  9658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.811829  9658 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.61:40331
I20260928 13:03:23.811877  9725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.61:40331 every 8 connection(s)
I20260928 13:03:23.812220  9658 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
I20260928 13:03:23.813150  9726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:23.814635  9726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:03:23.818444  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9658
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.61@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:23.823673  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.815333 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37662 (local address 127.3.6.62:45131)
0928 13:03:23.815447 (+   114us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.815450 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.815563 (+   113us) server_negotiation.cc:407] Connection header received
0928 13:03:23.815995 (+   432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.815996 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.816006 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.816060 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.816621 (+   561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.817133 (+   512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.818049 (+   916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.818299 (+   250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.818366 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.820474 (+  2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.820475 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.820475 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.820483 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.821842 (+  1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.822471 (+   629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.822472 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.822472 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.822540 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.822919 (+   379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.822925 (+     6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.822925 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.823128 (+   203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.823214 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.823482 (+   268us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.823568 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260928 13:03:23.823768  9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.815297 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37662)
0928 13:03:23.815446 (+   149us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.815488 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.815916 (+   428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.816115 (+   199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.816118 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.816361 (+   243us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.816544 (+   183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.816548 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.817206 (+   658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.817207 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.817976 (+   769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.817978 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.818376 (+   398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.818385 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.818480 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.819080 (+   600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.819094 (+    14us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.820388 (+  1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.821926 (+  1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.821931 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.821933 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.822250 (+   317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.822618 (+   368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.822619 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.822620 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.822769 (+   149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.823217 (+   448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.823223 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.823351 (+   128us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.823438 (+    87us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.823548 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
I20260928 13:03:23.824474  9726 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:03:23.827521  9730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.818878 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.3.6.61:40331)
0928 13:03:23.819052 (+   174us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.819058 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.819131 (+    73us) server_negotiation.cc:407] Connection header received
0928 13:03:23.819166 (+    35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.819168 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.819189 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.819255 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.819821 (+   566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.820548 (+   727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.821263 (+   715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.821550 (+   287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.821625 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.824454 (+  2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.824458 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.824458 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.824465 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.826322 (+  1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.826629 (+   307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.826632 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.826632 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.826691 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.826871 (+   180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.826872 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.826872 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.827052 (+   180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.827184 (+   132us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.827259 (+    75us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.827409 (+   150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.61@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
I20260928 13:03:23.831923  9728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.824752 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41770)
0928 13:03:23.824932 (+   180us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.824941 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.824994 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.825116 (+   122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.825117 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.825277 (+   160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.825333 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.825334 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.826107 (+   773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.826108 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.826888 (+   780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.826890 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.827462 (+   572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.827464 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.827530 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.827930 (+   400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.827934 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.829063 (+  1129us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.831122 (+  2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.831123 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.831123 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.831282 (+   159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.831449 (+   167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.831450 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.831450 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.831497 (+    47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.831684 (+   187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.831685 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.831723 (+    38us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.831794 (+    71us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.831866 (+    72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167}
I20260928 13:03:23.832073  9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.824803 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41770 (local address 127.3.6.61:40331)
0928 13:03:23.824970 (+   167us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.824972 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.824981 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:23.825044 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.825045 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.825054 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.825112 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.825454 (+   342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.826029 (+   575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.826955 (+   926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.827312 (+   357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.827418 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.829126 (+  1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.829127 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.829127 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.829132 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.831055 (+  1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.831348 (+   293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.831349 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.831349 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.831398 (+    49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.831533 (+   135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.831534 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.831534 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.831611 (+    77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.831655 (+    44us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.831809 (+   154us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.831916 (+   107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":145,"thread_start_us":100,"threads_started":1}
I20260928 13:03:23.833324  9726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Bootstrap starting.
I20260928 13:03:23.833868  9726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:23.834084  9726 log.cc:824] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:23.834698  9726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: No bootstrap required, opened a new log
I20260928 13:03:23.836056  9726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } }
I20260928 13:03:23.836174  9726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:23.836196  9726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92fe38e867f443a5bf1a932ba75cdf15, State: Initialized, Role: FOLLOWER
I20260928 13:03:23.836278  9726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } }
I20260928 13:03:23.836498  9733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } } }
I20260928 13:03:23.836560  9726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:23.836580  9733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:03:23.838129  9744 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:23.838184  9744 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:23.839560  9658 master_runner.cc:428] Detected that this master 92fe38e867f443a5bf1a932ba75cdf15 is joining an existing cluster
I20260928 13:03:23.839617  9658 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.6.61:40331
I20260928 13:03:23.847754  9751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.840744 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41780)
0928 13:03:23.841265 (+   521us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.841275 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.841322 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.841455 (+   133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.841455 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.841620 (+   165us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.841682 (+    62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.841684 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.842777 (+  1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.842778 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.843621 (+   843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.843622 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.843992 (+   370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843994 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.844055 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.844474 (+   419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.844479 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.844824 (+   345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.846639 (+  1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.846640 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.846641 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.846866 (+   225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.847096 (+   230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.847097 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.847097 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.847149 (+    52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.847414 (+   265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.847415 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.847459 (+    44us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.847534 (+    75us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.847631 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":64,"threads_started":1}
I20260928 13:03:23.848017  9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.840514 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37674)
0928 13:03:23.840678 (+   164us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.840688 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.840758 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.840941 (+   183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.840942 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.841078 (+   136us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.841150 (+    72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.841151 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.842299 (+  1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.842300 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.843262 (+   962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.843264 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.843772 (+   508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843791 (+    19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.843877 (+    86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.844315 (+   438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.844320 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.844774 (+   454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.846734 (+  1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.846735 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.846735 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.846998 (+   263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.847288 (+   290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.847289 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.847289 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.847356 (+    67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.847637 (+   281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.847638 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.847695 (+    57us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.847774 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.847885 (+   111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":75,"threads_started":1}
I20260928 13:03:23.848227  9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.840788 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41780 (local address 127.3.6.61:40331)
0928 13:03:23.840820 (+    32us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.840822 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.841332 (+   510us) server_negotiation.cc:407] Connection header received
0928 13:03:23.841367 (+    35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.841367 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.841377 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.841449 (+    72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.841761 (+   312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.842684 (+   923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843698 (+  1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.843917 (+   219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843994 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.844913 (+   919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.844914 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.844915 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.844920 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.846532 (+  1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.846945 (+   413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.846946 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.846946 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.846996 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.847222 (+   226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.847223 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.847223 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.847344 (+   121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.847415 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.847566 (+   151us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.848133 (+   567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":497,"server-negotiator.queue_time_us":17}
I20260928 13:03:23.848520  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.840577 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37674 (local address 127.3.6.62:45131)
0928 13:03:23.840621 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.840624 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.840733 (+   109us) server_negotiation.cc:407] Connection header received
0928 13:03:23.840835 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.840836 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.840855 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.840884 (+    29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.841232 (+   348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.842224 (+   992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843341 (+  1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.843648 (+   307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.843718 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.844869 (+  1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.844870 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.844870 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.844878 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.846641 (+  1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.847138 (+   497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.847140 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.847141 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.847213 (+    72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.847430 (+   217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.847431 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.847432 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.847573 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.847643 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.848390 (+   747us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.848463 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.62@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
I20260928 13:03:23.857405  9731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.850521 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41784 (local address 127.3.6.61:40331)
0928 13:03:23.850558 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.850560 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.850700 (+   140us) server_negotiation.cc:407] Connection header received
0928 13:03:23.850792 (+    92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.850792 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.850799 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.850845 (+    46us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.851323 (+   478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.851745 (+   422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.852820 (+  1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.852984 (+   164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.853031 (+    47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.854952 (+  1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.854953 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.854954 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.854961 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.856293 (+  1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.856670 (+   377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.856671 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.856672 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.856724 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.856910 (+   186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.856911 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.856911 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.857008 (+    97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.857078 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.857243 (+   165us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.857315 (+    72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:03:23.857450  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.850455 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41784)
0928 13:03:23.850599 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.850644 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.850720 (+    76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.850849 (+   129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.850851 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.851199 (+   348us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.851254 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.851256 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.851817 (+   561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.851818 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.852747 (+   929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.852749 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.853046 (+   297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.853049 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.853128 (+    79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.853508 (+   380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.853513 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.854870 (+  1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.856378 (+  1508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.856384 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.856387 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.856584 (+   197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.856786 (+   202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.856787 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.856788 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.856844 (+    56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.857071 (+   227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.857077 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.857126 (+    49us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.857219 (+    93us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.857325 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":80,"threads_started":1}
I20260928 13:03:23.857956  9194 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.6.61:40331: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
  permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15"
  member_type: NON_VOTER
  last_known_addr {
    host: "127.3.6.61"
    port: 40331
  }
  attrs {
    promote: true
  }
}
dest_uuid: "b1f438ab7d7c4c88a69b8c87e0623799"
cas_config_opid_index: -1
I20260928 13:03:23.858249  9194 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } }
I20260928 13:03:23.858669  9754 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } }
I20260928 13:03:23.858971  9700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:23.859766  9754 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.6.61:40331
I20260928 13:03:23.859877  9700 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260928 13:03:23.859863  9754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } }
I20260928 13:03:23.859925  9754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:23.860230  9658 master.cc:537] Master@127.3.6.61:40331 shutting down...
I20260928 13:03:23.860320  9753 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 13:03:23.860998  9180 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260928 13:03:23.861568  9180 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 -> Peer 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61:40331): Couldn't send request to peer 92fe38e867f443a5bf1a932ba75cdf15. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260928 13:03:23.862855  9658 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:23.862946  9658 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:23.862996  9658 tablet_replica.cc:330] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: stopping tablet replica
I20260928 13:03:23.875795  9658 master.cc:552] Master@127.3.6.61:40331 shutdown complete.
I20260928 13:03:23.875864  9658 master_runner.cc:305] Clearing existing system tablet
I20260928 13:03:23.875989  9658 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.876044  9658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.876669  9658 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:23.877115  9758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.877228  9658 fs_report.cc:383] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.877283  9658 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.877305  9658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "92fe38e867f443a5bf1a932ba75cdf15"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "d269de2f681bdbd13ef6112d05c4741c"
server_key_iv: "60a763cd22f0ac87dcecc794153931fb"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.877936  9658 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:23.879503  9658 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260928 13:03:23.879557  9658 log.cc:1196] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260928 13:03:23.879751  9658 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Deleting consensus metadata
I20260928 13:03:23.879870  9658 master_runner.cc:315] Copying system tablet from 127.3.6.62:45131
I20260928 13:03:23.880533  9658 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: tablet copy: Beginning tablet copy session from remote peer at address 127.3.6.62:45131
I20260928 13:03:23.887171  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.880907 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37690 (local address 127.3.6.62:45131)
0928 13:03:23.880954 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.880956 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.881026 (+    70us) server_negotiation.cc:407] Connection header received
0928 13:03:23.881100 (+    74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.881100 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.881109 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.881156 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.881540 (+   384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.882020 (+   480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.883196 (+  1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.883392 (+   196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.883447 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.884599 (+  1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.884600 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.884601 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.884607 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.886056 (+  1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.886452 (+   396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.886453 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.886453 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.886503 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.886692 (+   189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.886692 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.886692 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.886792 (+   100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.886837 (+    45us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.886992 (+   155us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.887105 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:23.887501  9764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.880820 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37690)
0928 13:03:23.880957 (+   137us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:23.880968 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:23.881038 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:23.881171 (+   133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:23.881172 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:23.881395 (+   223us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:23.881463 (+    68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.881465 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.882091 (+   626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.882092 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.883105 (+  1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:23.883110 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.883460 (+   350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.883463 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:23.883532 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.884074 (+   542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:23.884080 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:23.884501 (+   421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:23.886136 (+  1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.886138 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.886138 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.886374 (+   236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.886563 (+   189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:23.886564 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:23.886564 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:23.886628 (+    64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:23.886846 (+   218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:23.886847 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:23.886897 (+    50us) client_negotiation.cc:769] Sending connection context
0928 13:03:23.886978 (+    81us) client_negotiation.cc:240] Negotiation successful
0928 13:03:23.887118 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":94,"threads_started":1}
I20260928 13:03:23.887893  9214 tablet_copy_service.cc:140] P b1f438ab7d7c4c88a69b8c87e0623799: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 92fe38e867f443a5bf1a932ba75cdf15 ({username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:37690)
I20260928 13:03:23.888002  9214 tablet_copy_service.cc:161] P b1f438ab7d7c4c88a69b8c87e0623799: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 92fe38e867f443a5bf1a932ba75cdf15 at {username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:37690: session id = 92fe38e867f443a5bf1a932ba75cdf15-00000000000000000000000000000000
I20260928 13:03:23.888859  9214 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 13:03:23.889487  9658 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260928 13:03:23.890486  9658 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: tablet copy: Starting download of 0 data blocks...
I20260928 13:03:23.890657  9658 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: tablet copy: Starting download of 1 WAL segments...
I20260928 13:03:23.891709  9658 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 13:03:23.892513  9214 tablet_copy_service.cc:342] P b1f438ab7d7c4c88a69b8c87e0623799: Request end of tablet copy session 92fe38e867f443a5bf1a932ba75cdf15-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:37690
I20260928 13:03:23.892575  9214 tablet_copy_service.cc:433] P b1f438ab7d7c4c88a69b8c87e0623799: ending tablet copy session 92fe38e867f443a5bf1a932ba75cdf15-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 92fe38e867f443a5bf1a932ba75cdf15
I20260928 13:03:23.895092  9658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:23.896237  9768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:23.896234  9765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.896332  9658 server_base.cc:1034] running on GCE node
W20260928 13:03:23.896232  9766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:23.896602  9658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:23.896757  9658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:23.897876  9658 hybrid_clock.cc:648] HybridClock initialized: now 1790600603897865 us; error 28 us; skew 500 ppm
Sep 28 13:03:23 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:23.899367  9658 init.cc:377] Logged in from keytab as oryx/127.3.6.61@KRBTEST.COM (short username oryx)
I20260928 13:03:23.899637  9658 webserver.cc:460] Webserver started at http://127.3.6.61:44839/ using document root <none> and password file <none>
I20260928 13:03:23.899755  9658 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:23.899789  9658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:23.900488  9658 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:23.901055  9775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:23.901189  9658 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:23.901244  9658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "92fe38e867f443a5bf1a932ba75cdf15"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "d269de2f681bdbd13ef6112d05c4741c"
server_key_iv: "60a763cd22f0ac87dcecc794153931fb"
server_key_version: "encryptionkey@0"
I20260928 13:03:23.901304  9658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:23.912294  9658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:23.914011  9658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:23.917409  9658 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.61:40331
I20260928 13:03:23.917886  9658 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
I20260928 13:03:23.917907  9827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.61:40331 every 8 connection(s)
I20260928 13:03:23.918618  9828 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:03:23.919133  9828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Bootstrap starting.
I20260928 13:03:23.921403  9828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:03:23.921633  9828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Bootstrap complete.
I20260928 13:03:23.921841  9828 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } }
I20260928 13:03:23.921929  9828 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 92fe38e867f443a5bf1a932ba75cdf15, State: Initialized, Role: LEARNER
I20260928 13:03:23.921972  9828 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } }
I20260928 13:03:23.922154  9828 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:23.922151  9831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } }
I20260928 13:03:23.922273  9831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: LEARNER
I20260928 13:03:23.923709  9842 catalog_manager.cc:1259] Loaded cluster ID: d2537b906a8d44b4b30ad6bfdbcaa5a4
I20260928 13:03:23.923779  9842 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: loading cluster ID for follower catalog manager: success
I20260928 13:03:23.924690  9842 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: acquiring CA information for follower catalog manager: success
I20260928 13:03:23.924964  9842 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:03:23.936316  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:23.929123 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41812 (local address 127.3.6.61:40331)
0928 13:03:23.929243 (+   120us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:23.929245 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:23.929263 (+    18us) server_negotiation.cc:407] Connection header received
0928 13:03:23.929344 (+    81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:23.929345 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:23.929359 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:23.929452 (+    93us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:23.930040 (+   588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.931101 (+  1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.931803 (+   702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:23.932115 (+   312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:23.932195 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:23.933406 (+  1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:23.933407 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:23.933407 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:23.933414 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:23.935091 (+  1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.935424 (+   333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.935425 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.935425 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.935492 (+    67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:23.935666 (+   174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:23.935668 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:23.935668 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:23.935806 (+   138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:23.935922 (+   116us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:23.936098 (+   176us) server_negotiation.cc:299] Negotiation successful
0928 13:03:23.936190 (+    92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":56,"threads_started":1}
WARNING: no policy specified for oryx/127.3.6.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.60.keytab.
Entry for principal oryx/127.3.6.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.60.keytab.
I20260928 13:03:23.966576  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:41155
--webserver_interface=127.3.6.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.60.keytab
--principal=oryx/127.3.6.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:24.060632  9846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:24.060832  9846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:24.060864  9846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:24.061945  9846 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:24.061985  9846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:24.061998  9846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:24.062011  9846 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:24.062023  9846 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:24.063545  9846 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.60.keytab
--principal=oryx/127.3.6.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:41155
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.6.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:24.063740  9846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:24.063925  9846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:24.068687  9852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.068701  9851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.068727  9854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.068861  9846 server_base.cc:1034] running on GCE node
I20260928 13:03:24.069226  9846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:24.069556  9846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:24.070742  9846 hybrid_clock.cc:648] HybridClock initialized: now 1790600604070737 us; error 36 us; skew 500 ppm
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:24.073486  9846 init.cc:377] Logged in from keytab as oryx/127.3.6.60@KRBTEST.COM (short username oryx)
I20260928 13:03:24.073948  9846 webserver.cc:460] Webserver started at http://127.3.6.60:40553/ using document root <none> and password file <none>
I20260928 13:03:24.074198  9846 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.074266  9846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.074405  9846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:24.075608  9846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/instance:
uuid: "3534549d8c134bc092560b6c7190aba6"
format_stamp: "Formatted at 2026-09-28 13:03:24 on dist-test-slave-ddvw"
server_key: "5d7e35e10f374073ad50ebcfdd28c4d2"
server_key_iv: "5112d01304ecbb56e6d93153252f2dbc"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.075975  9846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal/instance:
uuid: "3534549d8c134bc092560b6c7190aba6"
format_stamp: "Formatted at 2026-09-28 13:03:24 on dist-test-slave-ddvw"
server_key: "5d7e35e10f374073ad50ebcfdd28c4d2"
server_key_iv: "5112d01304ecbb56e6d93153252f2dbc"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.077279  9846 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:24.078029  9861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.078224  9846 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:24.078363  9846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "3534549d8c134bc092560b6c7190aba6"
format_stamp: "Formatted at 2026-09-28 13:03:24 on dist-test-slave-ddvw"
server_key: "5d7e35e10f374073ad50ebcfdd28c4d2"
server_key_iv: "5112d01304ecbb56e6d93153252f2dbc"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.078449  9846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.098225  9846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:24.100270  9846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:24.100428  9846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:24.104377  9846 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.60:41155
I20260928 13:03:24.104460  9913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.60:41155 every 8 connection(s)
I20260928 13:03:24.104857  9846 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
I20260928 13:03:24.106009  9914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:24.107599  9914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:03:24.112365  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9846
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.60@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:24.116478  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.108369 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.3.6.62:45131)
0928 13:03:24.108436 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.108439 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.108568 (+   129us) server_negotiation.cc:407] Connection header received
0928 13:03:24.109039 (+   471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.109040 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.109052 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.109116 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.109726 (+   610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.110217 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.111242 (+  1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.111433 (+   191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.111499 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.113695 (+  2196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.113697 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.113697 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.113705 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.115156 (+  1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.115577 (+   421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.115578 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.115579 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.115637 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.115870 (+   233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.115871 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.115872 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.115980 (+   108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.116052 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.116315 (+   263us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.116391 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:03:24.116667  9916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.108235 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37698)
0928 13:03:24.108445 (+   210us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.108491 (+    46us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.108938 (+   447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.109188 (+   250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.109191 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.109453 (+   262us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.109632 (+   179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.109636 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.110305 (+   669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.110306 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.111153 (+   847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.111155 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.111505 (+   350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.111516 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.111630 (+   114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.112142 (+   512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.112150 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.113609 (+  1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.115262 (+  1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.115267 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.115269 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.115490 (+   221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.115699 (+   209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.115699 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.115700 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.115804 (+   104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.116043 (+   239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.116049 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.116183 (+   134us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.116279 (+    96us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.116431 (+   152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":101,"threads_started":1}
I20260928 13:03:24.117172  9914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600602, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
I20260928 13:03:24.121371  9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.112867 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33492 (local address 127.3.6.60:41155)
0928 13:03:24.113023 (+   156us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.113028 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.113053 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:03:24.113071 (+    18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.113072 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.113087 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.113167 (+    80us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.113796 (+   629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.114454 (+   658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.115313 (+   859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.115597 (+   284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.115677 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.118266 (+  2589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.118273 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.118273 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.118280 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.120084 (+  1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.120523 (+   439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.120526 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.120527 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.120603 (+    76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.120814 (+   211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.120815 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.120816 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.120976 (+   160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.121143 (+   167us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.121243 (+   100us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.121301 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.60@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
I20260928 13:03:24.124548  9916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.117413 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41816)
0928 13:03:24.117455 (+    42us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.117465 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.117498 (+    33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.118057 (+   559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.118058 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.118174 (+   116us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.118229 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.118231 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.119161 (+   930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.119162 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.119728 (+   566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.119731 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.120160 (+   429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.120163 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.120232 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.120622 (+   390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.120626 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.122069 (+  1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.123722 (+  1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.123723 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.123723 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.123923 (+   200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.124124 (+   201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.124124 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.124125 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.124166 (+    41us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.124356 (+   190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.124357 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.124387 (+    30us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.124431 (+    44us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.124494 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260928 13:03:24.124614  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.117851 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41816 (local address 127.3.6.61:40331)
0928 13:03:24.117903 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.117905 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.117912 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:24.117936 (+    24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.117937 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.117948 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.118014 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.118298 (+   284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.119055 (+   757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.119833 (+   778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.120051 (+   218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.120082 (+    31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.122162 (+  2080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.122164 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.122164 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.122172 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.123633 (+  1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.124009 (+   376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.124011 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.124011 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.124067 (+    56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.124215 (+   148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.124215 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.124215 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.124314 (+    99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.124366 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.124448 (+    82us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.124523 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 13:03:24.124993  9914 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.60@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
I20260928 13:03:24.131089  9916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.125218 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33500)
0928 13:03:24.125258 (+    40us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.125268 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.125305 (+    37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.125422 (+   117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.125423 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.125542 (+   119us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.125564 (+    22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.125566 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.126152 (+   586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.126153 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.126611 (+   458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.126612 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.126976 (+   364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.126978 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.127043 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.127352 (+   309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.127356 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.128669 (+  1313us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.130154 (+  1485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.130155 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.130155 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.130358 (+   203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.130557 (+   199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.130558 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.130558 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.130607 (+    49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.130833 (+   226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.130834 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.130868 (+    34us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.130918 (+    50us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.130986 (+    68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260928 13:03:24.131170  9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.125264 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33500 (local address 127.3.6.60:41155)
0928 13:03:24.125296 (+    32us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.125297 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.125305 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:24.125354 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.125355 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.125370 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.125411 (+    41us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.125630 (+   219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.126080 (+   450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.126696 (+   616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.126901 (+   205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.126977 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.128743 (+  1766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.128744 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.128745 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.128750 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.130091 (+  1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.130454 (+   363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.130455 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.130455 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.130503 (+    48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.130654 (+   151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.130654 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.130654 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.130782 (+   128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.130834 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.130942 (+   108us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.131082 (+   140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":17}
I20260928 13:03:24.132376  9914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Bootstrap starting.
I20260928 13:03:24.133201  9914 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:24.133481  9914 log.cc:824] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:24.134124  9914 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: No bootstrap required, opened a new log
I20260928 13:03:24.135546  9914 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } }
I20260928 13:03:24.135685  9914 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:24.135730  9914 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3534549d8c134bc092560b6c7190aba6, State: Initialized, Role: FOLLOWER
I20260928 13:03:24.135885  9914 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } }
I20260928 13:03:24.136171  9914 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:24.136144  9919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } } }
I20260928 13:03:24.136252  9919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:03:24.137770  9930 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:24.137814  9930 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:24.139892  9846 master_runner.cc:428] Detected that this master 3534549d8c134bc092560b6c7190aba6 is joining an existing cluster
I20260928 13:03:24.139942  9846 master_runner.cc:432] Initiating AddMaster RPC to add 127.3.6.60:41155
I20260928 13:03:24.148177  9938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.141537 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33502)
0928 13:03:24.141631 (+    94us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.141639 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.141683 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.142227 (+   544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.142227 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.142391 (+   164us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.142445 (+    54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.142446 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.143284 (+   838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.143284 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144155 (+   871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.144156 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144640 (+   484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144642 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144695 (+    53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.145178 (+   483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.145183 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.145497 (+   314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.147154 (+  1657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.147155 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.147155 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.147319 (+   164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.147529 (+   210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.147530 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.147530 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.147582 (+    52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.147822 (+   240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.147823 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.147860 (+    37us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.147924 (+    64us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.148048 (+   124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":58,"thread_start_us":58,"threads_started":1}
I20260928 13:03:24.148180  9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.141819 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33502 (local address 127.3.6.60:41155)
0928 13:03:24.141863 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.141865 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.141871 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:24.141887 (+    16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.141888 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.141896 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.141953 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.142525 (+   572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.143206 (+   681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144250 (+  1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144518 (+   268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144560 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.145607 (+  1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.145608 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.145609 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.145615 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.147064 (+  1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.147399 (+   335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.147400 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.147400 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.147449 (+    49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.147645 (+   196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.147645 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.147646 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.147762 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.147831 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.147948 (+   117us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.148099 (+   151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":18}
I20260928 13:03:24.154156  9919 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:24.154292  9919 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } }
I20260928 13:03:24.154574  9919 leader_election.cc:288] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61:40331)
I20260928 13:03:24.154805  9802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3534549d8c134bc092560b6c7190aba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92fe38e867f443a5bf1a932ba75cdf15" is_pre_election: true
I20260928 13:03:24.154843  9204 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3534549d8c134bc092560b6c7190aba6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" is_pre_election: true
I20260928 13:03:24.154942  9802 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Handling vote request from an unknown peer 3534549d8c134bc092560b6c7190aba6
I20260928 13:03:24.154992  9802 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate 3534549d8c134bc092560b6c7190aba6 for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260928 13:03:24.155275  9864 leader_election.cc:302] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6; no voters: 92fe38e867f443a5bf1a932ba75cdf15, b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:24.155439  9919 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:24.156183  9919 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260928 13:03:24.171510  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.141022 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.3.6.62:45131)
0928 13:03:24.141107 (+    85us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.141109 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.141514 (+   405us) server_negotiation.cc:407] Connection header received
0928 13:03:24.141562 (+    48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.141563 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.141574 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.141637 (+    63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.142114 (+   477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.142888 (+   774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144293 (+  1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144588 (+   295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144630 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.168452 (+ 23822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.168454 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.168455 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.168463 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.170145 (+  1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170600 (+   455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.170602 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.170602 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.170667 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170888 (+   221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.170889 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.170889 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.171051 (+   162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.171129 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.171325 (+   196us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.171410 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260928 13:03:24.171554  9937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.141328 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37706)
0928 13:03:24.141441 (+   113us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.141451 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.141504 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.141684 (+   180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.141685 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.141939 (+   254us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.142019 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.142021 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.142999 (+   978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.143000 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144186 (+  1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.144189 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144708 (+   519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144710 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144771 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.167677 (+ 22906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.167692 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.168335 (+   643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.170265 (+  1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170266 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.170267 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.170452 (+   185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.170742 (+   290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170743 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.170743 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.170820 (+    77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.171130 (+   310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.171131 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.171199 (+    68us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.171291 (+    92us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.171421 (+   130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":51,"thread_start_us":69,"threads_started":1}
I20260928 13:03:24.171903  9936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.140931 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41820)
0928 13:03:24.141126 (+   195us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.141137 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.141193 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.141828 (+   635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.141828 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.142056 (+   228us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.142103 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.142104 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.143135 (+  1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.143135 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144155 (+  1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.144156 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144654 (+   498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144655 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.144721 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.167792 (+ 23071us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.167797 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.168330 (+   533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.170500 (+  2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170501 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.170501 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.170688 (+   187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.170940 (+   252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170940 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.170941 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.170987 (+    46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.171341 (+   354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.171342 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.171379 (+    37us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.171448 (+    69us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.171535 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":47,"thread_start_us":88,"threads_started":1}
I20260928 13:03:24.172395  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.141063 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41820 (local address 127.3.6.61:40331)
0928 13:03:24.141646 (+   583us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.141648 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.141658 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:24.141681 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.141682 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.141691 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.141740 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.142177 (+   437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.142969 (+   792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144247 (+  1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.144543 (+   296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.144607 (+    64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.168478 (+ 23871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.168479 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.168480 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.168488 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.170412 (+  1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.170797 (+   385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.170798 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.170798 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.170858 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.171099 (+   241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.171100 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.171101 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.171243 (+   142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.171313 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.172192 (+   879us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.172303 (+   111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557}
I20260928 13:03:24.172899  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9256
I20260928 13:03:24.179140  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:46533
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:45131
--webserver_port=42137
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600603, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.62@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
I20260928 13:03:24.186580  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.177107 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33510)
0928 13:03:24.178685 (+  1578us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.178696 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.178748 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.178917 (+   169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.178919 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.179125 (+   206us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.179170 (+    45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.179172 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.180066 (+   894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.180067 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.181033 (+   966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.181035 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.181565 (+   530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.181568 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.181664 (+    96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.182137 (+   473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.182143 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.183699 (+  1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.185448 (+  1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.185450 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.185451 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.185639 (+   188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.185868 (+   229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.185869 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.185869 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.185941 (+    72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.186217 (+   276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.186218 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.186272 (+    54us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.186362 (+    90us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.186473 (+   111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1556}
I20260928 13:03:24.186580  9917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.178633 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.3.6.60:41155)
0928 13:03:24.178692 (+    59us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.178694 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.178733 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:24.178814 (+    81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.178815 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.178824 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.178912 (+    88us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.179331 (+   419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.179965 (+   634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.181130 (+  1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.181476 (+   346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.181539 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.183804 (+  2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.183806 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.183806 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.183815 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.185337 (+  1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.185735 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.185737 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.185737 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.185799 (+    62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.186007 (+   208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.186008 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.186008 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.186140 (+   132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.186219 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.186389 (+   170us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.186473 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 13:03:24.187300  9194 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.3.6.60:41155: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
  permanent_uuid: "3534549d8c134bc092560b6c7190aba6"
  member_type: NON_VOTER
  last_known_addr {
    host: "127.3.6.60"
    port: 41155
  }
  attrs {
    promote: true
  }
}
dest_uuid: "b1f438ab7d7c4c88a69b8c87e0623799"
cas_config_opid_index: 5
I20260928 13:03:24.187558  9194 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } }
I20260928 13:03:24.187898  9754 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3534549d8c134bc092560b6c7190aba6 (127.3.6.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.189002  9754 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.3.6.60:41155
I20260928 13:03:24.189093  9754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.189169  9754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.189600  9846 master.cc:537] Master@127.3.6.60:41155 shutting down...
I20260928 13:03:24.190064  9888 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260928 13:03:24.190311  9753 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 13:03:24.191234  9178 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 -> Peer 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155): Couldn't send request to peer 3534549d8c134bc092560b6c7190aba6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260928 13:03:24.193125  9846 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:24.193213  9846 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:24.193259  9846 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: stopping tablet replica
I20260928 13:03:24.194115  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.188033 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41824)
0928 13:03:24.188289 (+   256us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.188301 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.188352 (+    51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.188586 (+   234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.188587 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.188588 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.188628 (+    40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.188629 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.190769 (+  2140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.190770 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.192299 (+  1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.192302 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.193301 (+   999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.193302 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.193369 (+    67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.193393 (+    24us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.193979 (+   586us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.194032 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260928 13:03:24.194401  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.188133 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.3.6.61:40331)
0928 13:03:24.188258 (+   125us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.188260 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.188417 (+   157us) server_negotiation.cc:407] Connection header received
0928 13:03:24.188444 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.188445 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.188471 (+    26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.188531 (+    60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.188705 (+   174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.190661 (+  1956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.192397 (+  1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.193084 (+   687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.193163 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.193262 (+    99us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.194278 (+  1016us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.194325 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260928 13:03:24.194721  9802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260928 13:03:24.195225  9753 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 13:03:24.195911  9802 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3534549d8c134bc092560b6c7190aba6 (127.3.6.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.196902  9831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f438ab7d7c4c88a69b8c87e0623799. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.196993  9831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: LEARNER
I20260928 13:03:24.197036  9831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: NON_VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: true } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.197067  9753 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: attempting to promote NON_VOTER 92fe38e867f443a5bf1a932ba75cdf15 to VOTER
I20260928 13:03:24.197086  9831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: LEARNER
I20260928 13:03:24.197305  9753 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } }
I20260928 13:03:24.197930  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.197807 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33512)
0928 13:03:24.197861 (+    54us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.197904 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 13:03:24.197952  9802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 LEARNER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260928 13:03:24.198299  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.198183 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33522)
0928 13:03:24.198221 (+    38us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.198246 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41155: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260928 13:03:24.198246  9942 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260928 13:03:24.198441  9178 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 -> Peer 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155): Couldn't send request to peer 3534549d8c134bc092560b6c7190aba6. Status: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41155: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 13:03:24.198833  9754 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.199594  9754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.199674  9754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.199731  9754 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.199785  9754 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.200002  9802 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.200820  9941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.200959  9941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:03:24.206640  9846 master.cc:552] Master@127.3.6.60:41155 shutdown complete.
I20260928 13:03:24.206691  9846 master_runner.cc:305] Clearing existing system tablet
I20260928 13:03:24.206811  9846 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.206882  9846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.207556  9846 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.208176  9944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.208295  9846 fs_report.cc:383] FS layout report
--------------------
wal directory: 
metadata directory: 
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.208365  9846 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.208389  9846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "3534549d8c134bc092560b6c7190aba6"
format_stamp: "Formatted at 2026-09-28 13:03:24 on dist-test-slave-ddvw"
server_key: "5d7e35e10f374073ad50ebcfdd28c4d2"
server_key_iv: "5112d01304ecbb56e6d93153252f2dbc"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.209100  9846 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:24.210551  9846 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260928 13:03:24.210614  9846 log.cc:1196] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260928 13:03:24.210801  9846 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Deleting consensus metadata
I20260928 13:03:24.210912  9846 master_runner.cc:315] Copying system tablet from 127.3.6.62:45131
I20260928 13:03:24.211490  9846 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: tablet copy: Beginning tablet copy session from remote peer at address 127.3.6.62:45131
I20260928 13:03:24.218632  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.211918 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37716 (local address 127.3.6.62:45131)
0928 13:03:24.211957 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.211959 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.211968 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:24.212015 (+    47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.212016 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.212025 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.212090 (+    65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.212436 (+   346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.213213 (+   777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.214190 (+   977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.214489 (+   299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.214563 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.215667 (+  1104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.215669 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.215669 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.215677 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.217372 (+  1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.217795 (+   423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.217796 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.217796 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.217860 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.218075 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.218076 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.218076 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.218227 (+   151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.218297 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.218462 (+   165us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.218541 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:24.218647  9950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.211745 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:37716)
0928 13:03:24.211884 (+   139us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.211896 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.211956 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.212098 (+   142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.212098 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.212292 (+   194us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.212363 (+    71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.212365 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.213293 (+   928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.213294 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.214102 (+   808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.214105 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.214567 (+   462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.214570 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.214634 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.215184 (+   550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.215190 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.215574 (+   384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.217457 (+  1883us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.217458 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.217459 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.217700 (+   241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.217929 (+   229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.217931 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.217931 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.218002 (+    71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.218297 (+   295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.218297 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.218351 (+    54us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.218424 (+    73us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.218531 (+   107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
I20260928 13:03:24.219273  9214 tablet_copy_service.cc:140] P b1f438ab7d7c4c88a69b8c87e0623799: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3534549d8c134bc092560b6c7190aba6 ({username='oryx', principal='oryx/127.3.6.60@KRBTEST.COM'} at 127.0.0.1:37716)
I20260928 13:03:24.219328  9214 tablet_copy_service.cc:161] P b1f438ab7d7c4c88a69b8c87e0623799: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3534549d8c134bc092560b6c7190aba6 at {username='oryx', principal='oryx/127.3.6.60@KRBTEST.COM'} at 127.0.0.1:37716: session id = 3534549d8c134bc092560b6c7190aba6-00000000000000000000000000000000
I20260928 13:03:24.219945  9214 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 13:03:24.220439  9846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260928 13:03:24.221817  9846 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: tablet copy: Starting download of 0 data blocks...
I20260928 13:03:24.221958  9846 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: tablet copy: Starting download of 1 WAL segments...
I20260928 13:03:24.222721  9846 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 13:03:24.223752  9214 tablet_copy_service.cc:342] P b1f438ab7d7c4c88a69b8c87e0623799: Request end of tablet copy session 3534549d8c134bc092560b6c7190aba6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.3.6.60@KRBTEST.COM'} at 127.0.0.1:37716
I20260928 13:03:24.223814  9214 tablet_copy_service.cc:433] P b1f438ab7d7c4c88a69b8c87e0623799: ending tablet copy session 3534549d8c134bc092560b6c7190aba6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3534549d8c134bc092560b6c7190aba6
I20260928 13:03:24.226135  9846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:24.227250  9951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.227505  9952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.227525  9954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.231180  9846 server_base.cc:1034] running on GCE node
I20260928 13:03:24.231278  9846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:24.231426  9846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:24.232550  9846 hybrid_clock.cc:648] HybridClock initialized: now 1790600604232538 us; error 29 us; skew 500 ppm
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:24.234100  9846 init.cc:377] Logged in from keytab as oryx/127.3.6.60@KRBTEST.COM (short username oryx)
I20260928 13:03:24.234339  9846 webserver.cc:460] Webserver started at http://127.3.6.60:35303/ using document root <none> and password file <none>
I20260928 13:03:24.234460  9846 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.234493  9846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.235158  9846 fs_manager.cc:709] Time spent opening directory manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:24.235711  9961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.235881  9846 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.235931  9846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "3534549d8c134bc092560b6c7190aba6"
format_stamp: "Formatted at 2026-09-28 13:03:24 on dist-test-slave-ddvw"
server_key: "5d7e35e10f374073ad50ebcfdd28c4d2"
server_key_iv: "5112d01304ecbb56e6d93153252f2dbc"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.235983  9846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.249396  9846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:24.251472  9846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:24.254498  9846 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.60:41155
I20260928 13:03:24.254629 10013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.60:41155 every 8 connection(s)
I20260928 13:03:24.254994  9846 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
I20260928 13:03:24.256027 10014 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:03:24.256503 10014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Bootstrap starting.
I20260928 13:03:24.259335 10014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:03:24.259572 10014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: Bootstrap complete.
I20260928 13:03:24.259761 10014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } }
I20260928 13:03:24.259846 10014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3534549d8c134bc092560b6c7190aba6, State: Initialized, Role: LEARNER
I20260928 13:03:24.259882 10014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } }
I20260928 13:03:24.260066 10014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:24.260062 10017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.260296 10017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: LEARNER
I20260928 13:03:24.261809 10028 catalog_manager.cc:1259] Loaded cluster ID: d2537b906a8d44b4b30ad6bfdbcaa5a4
I20260928 13:03:24.261897 10028 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: loading cluster ID for follower catalog manager: success
I20260928 13:03:24.263316 10028 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: acquiring CA information for follower catalog manager: success
I20260928 13:03:24.263679 10028 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260928 13:03:24.281273  9939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:24.281486  9939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:24.281512  9939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:24.282723  9939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:24.282760  9939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:24.282789  9939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:24.284574  9939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:46533
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=42137
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:24.284832  9939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:24.285068  9939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:24.291025 10033 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.290983 10034 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.290983 10036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.291311  9939 server_base.cc:1034] running on GCE node
I20260928 13:03:24.291579  9939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:24.291817  9939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:24.292970  9939 hybrid_clock.cc:648] HybridClock initialized: now 1790600604292954 us; error 31 us; skew 500 ppm
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:24.295765  9939 init.cc:377] Logged in from keytab as oryx/127.3.6.1@KRBTEST.COM (short username oryx)
I20260928 13:03:24.296277  9939 webserver.cc:460] Webserver started at http://127.3.6.1:42137/ using document root <none> and password file <none>
I20260928 13:03:24.296528  9939 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.296605  9939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.297987  9939 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:24.298573 10043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.298753  9939 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:24.298856  9939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "e7163ccfb1a14dc38e39e321519b11d6"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "50c2c7548079d8bd713519643f8f2bf7"
server_key_iv: "49a01acec07dfa6b0392ac7f83dcf2d3"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.299340  9939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.309522  9939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:24.311431  9939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:24.311553  9939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:24.311733  9939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:24.311981  9939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:24.312012  9939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.312034  9939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:24.312047  9939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.317667  9939 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:46533
I20260928 13:03:24.317746 10156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:46533 every 8 connection(s)
I20260928 13:03:24.318094  9939 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:24.325426  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 9939
I20260928 13:03:24.325603  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9390
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
I20260928 13:03:24.330727 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.318894 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:57011 (local address 127.3.6.60:41155)
0928 13:03:24.319085 (+   191us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.319087 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.320605 (+  1518us) server_negotiation.cc:407] Connection header received
0928 13:03:24.320629 (+    24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.320630 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.320641 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.320739 (+    98us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.321307 (+   568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.322587 (+  1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323924 (+  1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.324277 (+   353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.324332 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.327227 (+  2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.327228 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.327229 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.327237 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.329059 (+  1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.329623 (+   564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.329625 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.329625 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.329693 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.330017 (+   324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.330018 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.330018 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.330144 (+   126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.330218 (+    74us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.330512 (+   294us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.330600 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":91,"threads_started":1}
I20260928 13:03:24.330928 10162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.318931 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.3.6.1:57011)
0928 13:03:24.319213 (+   282us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.319250 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.320289 (+  1039us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.320788 (+   499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.320789 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.321044 (+   255us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.321201 (+   157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.321203 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.322738 (+  1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.322739 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.323833 (+  1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.323835 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.324346 (+   511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.324349 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.324421 (+    72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.324878 (+   457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.324882 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.327126 (+  2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.329149 (+  2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.329156 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.329159 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.329483 (+   324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.329792 (+   309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.329793 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.329793 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.329942 (+   149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.330210 (+   268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.330216 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.330367 (+   151us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.330478 (+   111us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.330695 (+   217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":3,"thread_start_us":109,"threads_started":1}
I20260928 13:03:24.331274  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.319082 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:55285 (local address 127.3.6.61:40331)
0928 13:03:24.319130 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.319133 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.319423 (+   290us) server_negotiation.cc:407] Connection header received
0928 13:03:24.320422 (+   999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.320424 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.320439 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.320516 (+    77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.321290 (+   774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.321853 (+   563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.322956 (+  1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.323272 (+   316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323347 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.327768 (+  4421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.327770 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.327770 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.327779 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.329836 (+  2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.330248 (+   412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.330249 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.330250 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.330307 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.330500 (+   193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.330501 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.330501 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.330667 (+   166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.330711 (+    44us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.331042 (+   331us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.331132 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:24.331393 10157 heartbeater.cc:347] Connected to a master server at 127.3.6.60:41155
I20260928 13:03:24.331499 10157 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.331657 10164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.318932 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.3.6.1:55285)
0928 13:03:24.319357 (+   425us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.319367 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.320324 (+   957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.320610 (+   286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.320614 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.320985 (+   371us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.321197 (+   212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.321201 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.321950 (+   749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.321950 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.322872 (+   922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.322875 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.323350 (+   475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323363 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.323499 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.324405 (+   906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.324409 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.327380 (+  2971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.329914 (+  2534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.329915 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.329916 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.330147 (+   231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.330378 (+   231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.330379 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.330379 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.330437 (+    58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.330775 (+   338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.330775 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.330896 (+   121us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.331388 (+   492us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.331505 (+   117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"mutex_wait_us":3,"thread_start_us":115,"threads_started":1}
I20260928 13:03:24.331683 10157 heartbeater.cc:511] Master 127.3.6.60:41155 requested a full tablet report, sending...
I20260928 13:03:24.332233  9978 ts_manager.cc:194] Registered new tserver with Master: e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
I20260928 13:03:24.332383 10159 heartbeater.cc:347] Connected to a master server at 127.3.6.61:40331
I20260928 13:03:24.332434 10159 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.332516 10159 heartbeater.cc:511] Master 127.3.6.61:40331 requested a full tablet report, sending...
I20260928 13:03:24.332871  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:43463
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:45131
--webserver_port=38253
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:03:24.332911  9792 ts_manager.cc:194] Registered new tserver with Master: e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
I20260928 13:03:24.334447  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.319347 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47241 (local address 127.3.6.62:45131)
0928 13:03:24.319399 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.319401 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.320548 (+  1147us) server_negotiation.cc:407] Connection header received
0928 13:03:24.320595 (+    47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.320596 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.320608 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.320671 (+    63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.321311 (+   640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.322130 (+   819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323337 (+  1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.323672 (+   335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323716 (+    44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.326751 (+  3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.326752 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.326753 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.326761 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.333319 (+  6558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.333659 (+   340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.333660 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.333660 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.333733 (+    73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.333921 (+   188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.333922 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.333923 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.334042 (+   119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.334115 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.334273 (+   158us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.334355 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:03:24.334465 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.319260 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:47241)
0928 13:03:24.320473 (+  1213us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.320484 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.320537 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.320689 (+   152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.320690 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.321049 (+   359us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.321193 (+   144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.321200 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.322242 (+  1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.322243 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.323238 (+   995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.323240 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.323805 (+   565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.323808 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.323873 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.324287 (+   414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.324296 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.326646 (+  2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.333401 (+  6755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.333402 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.333402 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.333585 (+   183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.333797 (+   212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.333798 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.333798 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.333855 (+    57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.334105 (+   250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.334106 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.334149 (+    43us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.334248 (+    99us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.334356 (+   108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1196,"mutex_wait_us":8,"thread_start_us":60,"threads_started":1}
I20260928 13:03:24.335165 10158 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
I20260928 13:03:24.335233 10158 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.335302 10158 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:24.335685  9194 ts_manager.cc:194] Re-registered known tserver with Master: e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
I20260928 13:03:24.336127  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:47241
W20260928 13:03:24.414656 10165 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:24.414902 10165 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:24.414942 10165 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:24.416119 10165 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:24.416191 10165 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:24.416236 10165 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:24.417819 10165 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:43463
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=38253
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10165
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:24.418092 10165 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:24.418319 10165 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:24.423661 10171 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.423763 10173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.423717 10165 server_base.cc:1034] running on GCE node
W20260928 13:03:24.423772 10170 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.424082 10165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:24.424288 10165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:24.425422 10165 hybrid_clock.cc:648] HybridClock initialized: now 1790600604425410 us; error 27 us; skew 500 ppm
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:24.428076 10165 init.cc:377] Logged in from keytab as oryx/127.3.6.2@KRBTEST.COM (short username oryx)
I20260928 13:03:24.428576 10165 webserver.cc:460] Webserver started at http://127.3.6.2:38253/ using document root <none> and password file <none>
I20260928 13:03:24.428894 10165 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.428974 10165 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.430461 10165 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:24.431102 10180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.431267 10165 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:24.431357 10165 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "778b13b0e7b5462a8445b1b50d5db006"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "be24245f5b3d52db57edd6d0d6a6f12e"
server_key_iv: "b491fd09c076b242a07b4ff0e946574e"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.431706 10165 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.449584 10165 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:24.452147 10165 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:24.452319 10165 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:24.452566 10165 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:24.452877 10165 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:24.452926 10165 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.452962 10165 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:24.452989 10165 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.458887 10165 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:43463
I20260928 13:03:24.458928 10293 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:43463 every 8 connection(s)
I20260928 13:03:24.459328 10165 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:24.474946  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460139 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:42383 (local address 127.3.6.62:45131)
0928 13:03:24.460213 (+    74us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.460215 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.460449 (+   234us) server_negotiation.cc:407] Connection header received
0928 13:03:24.461098 (+   649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.461100 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.461121 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.461166 (+    45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.462117 (+   951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462852 (+   735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.464827 (+  1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.465289 (+   462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.465361 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.469454 (+  4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.469455 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.469456 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.469463 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.471372 (+  1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.473025 (+  1653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.473026 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.473027 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.473091 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.474072 (+   981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.474073 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.474074 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.474223 (+   149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.474263 (+    40us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.474755 (+   492us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.474844 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 13:03:24.475355  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10165
I20260928 13:03:24.475512  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9524
I20260928 13:03:24.475518  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460089 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:39455 (local address 127.3.6.61:40331)
0928 13:03:24.460143 (+    54us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.460145 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.460574 (+   429us) server_negotiation.cc:407] Connection header received
0928 13:03:24.461093 (+   519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.461094 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.461107 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.461141 (+    34us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.462143 (+  1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462906 (+   763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.464579 (+  1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.464885 (+   306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.464927 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.469806 (+  4879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.469807 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.469808 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.469815 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.472112 (+  2297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.473502 (+  1390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.473504 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.473504 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.473573 (+    69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.473820 (+   247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.473821 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.473822 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.473968 (+   146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.474019 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.475337 (+  1318us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.475423 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:24.475701 10299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460076 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:42383)
0928 13:03:24.460285 (+   209us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.460330 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.460971 (+   641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.461264 (+   293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.461268 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.461812 (+   544us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.462027 (+   215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.462033 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462990 (+   957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.462991 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.464663 (+  1672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.464666 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.465465 (+   799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.465468 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.465544 (+    76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.466049 (+   505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.466055 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.469347 (+  3292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.472191 (+  2844us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.472200 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.472204 (+     4us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.472519 (+   315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.473174 (+   655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.473174 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.473175 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.473395 (+   220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.474615 (+  1220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.474616 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.474647 (+    31us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.475062 (+   415us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.475459 (+   397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":109,"thread_start_us":86,"threads_started":1}
I20260928 13:03:24.475900 10298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460076 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.3.6.2:39455)
0928 13:03:24.460505 (+   429us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.460517 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.460987 (+   470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.461263 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.461268 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.461795 (+   527us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.462028 (+   233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.462035 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462995 (+   960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.462996 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.464471 (+  1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.464474 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.465008 (+   534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.465020 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.465277 (+   257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.465902 (+   625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.465906 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.469045 (+  3139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.472618 (+  3573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.472618 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.472619 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.472922 (+   303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.473644 (+   722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.473644 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.473645 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.473743 (+    98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.474311 (+   568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.474317 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.474489 (+   172us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.475619 (+  1130us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.475738 (+   119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"mutex_wait_us":187,"thread_start_us":63,"threads_started":1}
I20260928 13:03:24.476356 10296 heartbeater.cc:347] Connected to a master server at 127.3.6.61:40331
I20260928 13:03:24.476449 10296 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.476656 10296 heartbeater.cc:511] Master 127.3.6.61:40331 requested a full tablet report, sending...
I20260928 13:03:24.477084  9792 ts_manager.cc:194] Registered new tserver with Master: 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463)
I20260928 13:03:24.478335 10295 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
I20260928 13:03:24.478384 10295 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.478485 10295 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:24.478717  9194 ts_manager.cc:194] Re-registered known tserver with Master: 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463)
I20260928 13:03:24.479212  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:42383
I20260928 13:03:24.481757 10300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460396 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.3.6.2:38537)
0928 13:03:24.460526 (+   130us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.460536 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.460987 (+   451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.461263 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.461268 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.461801 (+   533us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.462028 (+   227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.462035 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462995 (+   960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.462996 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.464471 (+  1475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.464474 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.465009 (+   535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.465021 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.465178 (+   157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.465883 (+   705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.465893 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.475329 (+  9436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.480762 (+  5433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.480763 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.480763 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.480934 (+   171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.481145 (+   211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.481146 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.481146 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.481213 (+    67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.481493 (+   280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.481493 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.481539 (+    46us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.481594 (+    55us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.481683 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":125,"thread_start_us":69,"threads_started":1}
I20260928 13:03:24.481877 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.460477 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:38537 (local address 127.3.6.60:41155)
0928 13:03:24.460519 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.460521 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.460582 (+    61us) server_negotiation.cc:407] Connection header received
0928 13:03:24.461093 (+   511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.461094 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.461107 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.461141 (+    34us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.462142 (+  1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.462894 (+   752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.464578 (+  1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.464886 (+   308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.464927 (+    41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.477959 (+ 13032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.477960 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.477961 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.477970 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.480678 (+  2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.480996 (+   318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.480998 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.480999 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.481063 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.481280 (+   217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.481281 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.481281 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.481428 (+   147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.481498 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.481639 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.481736 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:24.482195 10294 heartbeater.cc:347] Connected to a master server at 127.3.6.60:41155
I20260928 13:03:24.482249 10294 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.482302 10294 heartbeater.cc:511] Master 127.3.6.60:41155 requested a full tablet report, sending...
I20260928 13:03:24.482589  9978 ts_manager.cc:194] Registered new tserver with Master: 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463)
I20260928 13:03:24.483852  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:44257
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:45131
--webserver_port=37403
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:33163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:24.566674 10301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:24.566893 10301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:24.566919 10301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:24.568061 10301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:24.568101 10301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:24.568128 10301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:24.569504 10301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:44257
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=37403
--tserver_master_addrs=127.3.6.62:45131,127.3.6.61:40331,127.3.6.60:41155
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:24.569692 10301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:24.569885 10301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:24.574903 10306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.574882 10307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:24.574859 10309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:24.574913 10301 server_base.cc:1034] running on GCE node
I20260928 13:03:24.575244 10301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:24.575484 10301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:24.576665 10301 hybrid_clock.cc:648] HybridClock initialized: now 1790600604576646 us; error 30 us; skew 500 ppm
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:24.579244 10301 init.cc:377] Logged in from keytab as oryx/127.3.6.3@KRBTEST.COM (short username oryx)
I20260928 13:03:24.579658 10301 webserver.cc:460] Webserver started at http://127.3.6.3:37403/ using document root <none> and password file <none>
I20260928 13:03:24.579888 10301 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:24.579970 10301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:24.581310 10301 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:24.581907 10316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.582053 10301 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:24.582152 10301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "e3bc8937eb3248c3917c221eed0c318b"
format_stamp: "Formatted at 2026-09-28 13:03:23 on dist-test-slave-ddvw"
server_key: "e21ba869679b496b85640999931a694e"
server_key_iv: "8d8ca3054a2ba706c8b7f2f41c8051f4"
server_key_version: "encryptionkey@0"
I20260928 13:03:24.582507 10301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:24.593922 10301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:24.596025 10301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:24.596182 10301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:24.596412 10301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:24.596704 10301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:24.596755 10301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.596797 10301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:24.596825 10301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:24.602562 10301 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:44257
I20260928 13:03:24.602607 10429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:44257 every 8 connection(s)
I20260928 13:03:24.602937 10301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:24.608575  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10301
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.61@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.60@KRBTEST.COM
Sep 28 13:03:24 dist-test-slave-ddvw krb5kdc[9149](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600604, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:24.615558 10434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.603690 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.3.6.3:46289)
0928 13:03:24.603950 (+   260us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.603990 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.605056 (+  1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.605363 (+   307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.605368 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.605828 (+   460us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.606021 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.606027 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.606973 (+   946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.606974 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.608015 (+  1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.608017 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.608883 (+   866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608886 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.608952 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.609359 (+   407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.609366 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.611652 (+  2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.613514 (+  1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.613520 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.613522 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.614109 (+   587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.614334 (+   225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.614334 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.614335 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.614473 (+   138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.614804 (+   331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.614810 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.614966 (+   156us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.615115 (+   149us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.615286 (+   171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":16,"thread_start_us":88,"threads_started":1}
I20260928 13:03:24.616128  9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.603668 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:46289 (local address 127.3.6.61:40331)
0928 13:03:24.603711 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.603714 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.604071 (+   357us) server_negotiation.cc:407] Connection header received
0928 13:03:24.605166 (+  1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.605167 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.605190 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.605254 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.606128 (+   874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.606896 (+   768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608457 (+  1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.608751 (+   294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608823 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.611749 (+  2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.611750 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.611751 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.611759 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.613434 (+  1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.614202 (+   768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.614203 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.614203 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.614260 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.614547 (+   287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.614548 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.614548 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.614690 (+   142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.614775 (+    85us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.615936 (+  1161us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.616011 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:03:24.616667 10432 heartbeater.cc:347] Connected to a master server at 127.3.6.61:40331
I20260928 13:03:24.616779 10432 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.616992 10432 heartbeater.cc:511] Master 127.3.6.61:40331 requested a full tablet report, sending...
I20260928 13:03:24.617348  9233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.603772 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:45467 (local address 127.3.6.62:45131)
0928 13:03:24.603834 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.603836 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.604106 (+   270us) server_negotiation.cc:407] Connection header received
0928 13:03:24.605378 (+  1272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.605379 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.605388 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.605443 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.606112 (+   669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.606637 (+   525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608095 (+  1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.608283 (+   188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608354 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.613585 (+  5231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.613586 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.613587 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.613594 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.615513 (+  1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.616120 (+   607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.616121 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.616121 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.616179 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.616704 (+   525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.616705 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.616706 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.616843 (+   137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.616928 (+    85us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.617155 (+   227us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.617247 (+    92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 13:03:24.617460  9792 ts_manager.cc:194] Registered new tserver with Master: e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:24.617956 10436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.603692 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:45467)
0928 13:03:24.604051 (+   359us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.604060 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.605055 (+   995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.605463 (+   408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.605464 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.605825 (+   361us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.606020 (+   195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.606024 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.606741 (+   717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.606742 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.608015 (+  1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.608017 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.608360 (+   343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608370 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.608498 (+   128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.609331 (+   833us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.609341 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.613467 (+  4126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.615715 (+  2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.615716 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.615716 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.615913 (+   197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.616561 (+   648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.616561 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.616562 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.616643 (+    81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.616919 (+   276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.616920 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.616964 (+    44us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.617748 (+   784us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.617854 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":5,"thread_start_us":93,"threads_started":1}
I20260928 13:03:24.618481 10431 heartbeater.cc:347] Connected to a master server at 127.3.6.62:45131
I20260928 13:03:24.618526 10431 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.618597 10431 heartbeater.cc:511] Master 127.3.6.62:45131 requested a full tablet report, sending...
I20260928 13:03:24.618880  9194 ts_manager.cc:194] Re-registered known tserver with Master: e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:24.619392  9194 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:45467
I20260928 13:03:24.619586 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.604041 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:51185 (local address 127.3.6.60:41155)
0928 13:03:24.604115 (+    74us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.604118 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.604157 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:24.605263 (+  1106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.605265 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.605276 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.605327 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.606126 (+   799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.606899 (+   773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608996 (+  2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.609322 (+   326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.609367 (+    45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.616283 (+  6916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.616285 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.616285 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.616293 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.618236 (+  1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.618655 (+   419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.618656 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.618657 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.618730 (+    73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.618936 (+   206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.618937 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.618938 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.619105 (+   167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.619149 (+    44us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.619400 (+   251us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.619483 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 13:03:24.620400 10435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.603946 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.3.6.3:51185)
0928 13:03:24.604105 (+   159us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.604115 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.605072 (+   957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.605363 (+   291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.605368 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.605828 (+   460us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:24.606021 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.606027 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.608114 (+  2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.608115 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.608902 (+   787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.608905 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.609443 (+   538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.609445 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.609511 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.609904 (+   393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:24.609909 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:24.616040 (+  6131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:24.618326 (+  2286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.618326 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.618327 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.618570 (+   243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.618805 (+   235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:24.618806 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:24.618807 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:24.618864 (+    57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:24.619241 (+   377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:24.619242 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:24.619291 (+    49us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.619908 (+   617us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.620008 (+   100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260928 13:03:24.620677 10442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.609736 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37720 (local address 127.3.6.62:45131)
0928 13:03:24.610139 (+   403us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.610141 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.610149 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:24.610170 (+    21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.610171 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.610182 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.611052 (+   870us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.611092 (+    40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.611667 (+   575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.614161 (+  2494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.614448 (+   287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.614502 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.615963 (+  1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.615964 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.615964 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.615970 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.618702 (+  2732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.619332 (+   630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.619333 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.619333 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.619395 (+    62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.619606 (+   211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.619607 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.619607 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.619729 (+   122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.619818 (+    89us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.620470 (+   652us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.620563 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":82,"threads_started":1}
I20260928 13:03:24.620971 10430 heartbeater.cc:347] Connected to a master server at 127.3.6.60:41155
I20260928 13:03:24.621048 10430 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:24.621124 10430 heartbeater.cc:511] Master 127.3.6.60:41155 requested a full tablet report, sending...
I20260928 13:03:24.621541  9978 ts_manager.cc:194] Registered new tserver with Master: e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:24.623448 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.610793 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.3.6.61:40331)
0928 13:03:24.611795 (+  1002us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.611797 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.611804 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:24.611821 (+    17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.611822 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.611831 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.611889 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.613711 (+  1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.614432 (+   721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.615511 (+  1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.616000 (+   489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.616056 (+    56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.619904 (+  3848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.619905 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.619906 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.619913 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.622126 (+  2213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.622560 (+   434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.622561 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.622561 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.622614 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.622807 (+   193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.622808 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.622808 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.622967 (+   159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.623096 (+   129us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.623202 (+   106us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.623364 (+   162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":983,"thread_start_us":66,"threads_started":1}
I20260928 13:03:24.624357 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.609962 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33532 (local address 127.3.6.60:41155)
0928 13:03:24.610195 (+   233us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.610198 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.610357 (+   159us) server_negotiation.cc:407] Connection header received
0928 13:03:24.610378 (+    21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.610379 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.610391 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.610453 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.611148 (+   695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.611891 (+   743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.616133 (+  4242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.616484 (+   351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.616533 (+    49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.621246 (+  4713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.621247 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.621247 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.621254 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.623080 (+  1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.623586 (+   506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.623587 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.623589 (+     2us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.623645 (+    56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.623821 (+   176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.623821 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.623822 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.623932 (+   110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.624037 (+   105us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.624146 (+   109us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.624226 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":53,"threads_started":1}
I20260928 13:03:24.623484  9194 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:24.625415  9194 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:24.632591 10451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629154 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:44257 (local address 127.0.0.1:46566)
0928 13:03:24.629322 (+   168us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.629332 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.629376 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.629692 (+   316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.629694 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.629696 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.629752 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.629754 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.630769 (+  1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.630769 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.631620 (+   851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.631623 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.632334 (+   711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.632335 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.632404 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.632408 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.632469 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.632510 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":126,"threads_started":1}
I20260928 13:03:24.632603 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629268 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46566 (local address 127.3.6.3:44257)
0928 13:03:24.629496 (+   228us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.629501 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.629513 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:24.629556 (+    43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.629558 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.629577 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.629832 (+   255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.629889 (+    57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.630681 (+   792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.631709 (+  1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.632232 (+   523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.632331 (+    99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.632415 (+    84us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.632484 (+    69us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.632522 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":105,"threads_started":1}
I20260928 13:03:24.633509 10364 tablet_service.cc:1467] Processing CreateTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 (DEFAULT_TABLE table=test-table [id=9253802fb28340bb9c38b90ad253bdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:24.633822 10454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629445 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43463 (local address 127.0.0.1:43026)
0928 13:03:24.629590 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.629600 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.629656 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.629995 (+   339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.629996 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.629998 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.630061 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.630062 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.631736 (+  1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.631736 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.632804 (+  1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.632807 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.633520 (+   713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.633521 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.633591 (+    70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.633596 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.633688 (+    92us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.633731 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260928 13:03:24.633924 10364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc283500cf84cf38cfe82c002b4e8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:24.634011  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629055 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46533 (local address 127.0.0.1:53778)
0928 13:03:24.629320 (+   265us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.629332 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.629376 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.629939 (+   563us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.629940 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.629941 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.629969 (+    28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.629970 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.631251 (+  1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.631252 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.632354 (+  1102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.632357 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.633636 (+  1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.633637 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.633695 (+    58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.633699 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.633730 (+    31us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.633770 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248}
I20260928 13:03:24.634163 10452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629269 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43026 (local address 127.3.6.2:43463)
0928 13:03:24.629613 (+   344us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.629616 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.629645 (+    29us) server_negotiation.cc:407] Connection header received
0928 13:03:24.629807 (+   162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.629811 (+     4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.629827 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.629934 (+   107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.630136 (+   202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.631631 (+  1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.632896 (+  1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.633421 (+   525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.633516 (+    95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.633589 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.633718 (+   129us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.633755 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":91,"threads_started":1}
I20260928 13:03:24.634584 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.629470 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.3.6.1:46533)
0928 13:03:24.629759 (+   289us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.629764 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.629803 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:03:24.629842 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.629844 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.629858 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.629930 (+    72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.630022 (+    92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.631144 (+  1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.632449 (+  1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.633530 (+  1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.634327 (+   797us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.634447 (+   120us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.634473 (+    26us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.634514 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":107,"threads_started":1}
I20260928 13:03:24.634742 10228 tablet_service.cc:1467] Processing CreateTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 (DEFAULT_TABLE table=test-table [id=9253802fb28340bb9c38b90ad253bdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:24.635121 10228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc283500cf84cf38cfe82c002b4e8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:24.635205 10091 tablet_service.cc:1467] Processing CreateTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 (DEFAULT_TABLE table=test-table [id=9253802fb28340bb9c38b90ad253bdca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:24.635543 10091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdc283500cf84cf38cfe82c002b4e8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:24.637627 10456 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Bootstrap starting.
I20260928 13:03:24.638245 10457 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Bootstrap starting.
I20260928 13:03:24.638386 10456 tablet_bootstrap.cc:654] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:24.638769 10456 log.cc:824] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:24.638804 10458 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Bootstrap starting.
I20260928 13:03:24.638918 10457 tablet_bootstrap.cc:654] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:24.639263 10457 log.cc:824] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:24.639434 10458 tablet_bootstrap.cc:654] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:24.639739 10456 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: No bootstrap required, opened a new log
I20260928 13:03:24.639739 10458 log.cc:824] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:24.639842 10456 ts_tablet_manager.cc:1397] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:24.640034 10457 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: No bootstrap required, opened a new log
I20260928 13:03:24.640105 10457 ts_tablet_manager.cc:1397] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:24.640487 10458 tablet_bootstrap.cc:492] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: No bootstrap required, opened a new log
I20260928 13:03:24.640554 10458 ts_tablet_manager.cc:1397] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:24.641490 10457 raft_consensus.cc:348] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.641634 10457 raft_consensus.cc:374] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:24.641676 10457 raft_consensus.cc:729] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778b13b0e7b5462a8445b1b50d5db006, State: Initialized, Role: FOLLOWER
I20260928 13:03:24.641793 10457 consensus_queue.cc:260] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.642045 10457 ts_tablet_manager.cc:1428] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:24.642162 10295 heartbeater.cc:503] Master 127.3.6.62:45131 was elected leader, sending a full tablet report...
I20260928 13:03:24.642418 10456 raft_consensus.cc:348] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.642588 10456 raft_consensus.cc:374] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:24.642621 10456 raft_consensus.cc:729] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bc8937eb3248c3917c221eed0c318b, State: Initialized, Role: FOLLOWER
I20260928 13:03:24.642745 10456 consensus_queue.cc:260] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.643415 10458 raft_consensus.cc:348] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.643684 10458 raft_consensus.cc:374] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:24.643772 10458 raft_consensus.cc:729] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7163ccfb1a14dc38e39e321519b11d6, State: Initialized, Role: FOLLOWER
I20260928 13:03:24.643930 10458 consensus_queue.cc:260] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.644063 10456 ts_tablet_manager.cc:1428] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260928 13:03:24.644182 10431 heartbeater.cc:503] Master 127.3.6.62:45131 was elected leader, sending a full tablet report...
I20260928 13:03:24.644193 10458 ts_tablet_manager.cc:1428] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260928 13:03:24.644266 10158 heartbeater.cc:503] Master 127.3.6.62:45131 was elected leader, sending a full tablet report...
I20260928 13:03:24.656244 10464 raft_consensus.cc:482] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:24.656406 10464 raft_consensus.cc:504] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.656841 10464 leader_election.cc:288] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463), e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:24.660704 10452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.657092 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:52329 (local address 127.3.6.2:43463)
0928 13:03:24.657137 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.657139 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.657151 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:24.657197 (+    46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.657198 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.657210 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.657261 (+    51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.657468 (+   207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.658214 (+   746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.659726 (+  1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.660310 (+   584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.660389 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.660400 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.660563 (+   163us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.660606 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:24.660704 10453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.657096 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43903 (local address 127.3.6.3:44257)
0928 13:03:24.657143 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.657145 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.657151 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:24.657181 (+    30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.657182 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.657193 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.657253 (+    60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.657468 (+   215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.658206 (+   738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.659726 (+  1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.660310 (+   584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.660389 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.660400 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.660563 (+   163us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.660606 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260928 13:03:24.660778 10163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.657008 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:44257 (local address 127.3.6.1:43903)
0928 13:03:24.657063 (+    55us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.657075 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.657126 (+    51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.657274 (+   148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.657275 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.657276 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.657388 (+   112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.657390 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.658298 (+   908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.658299 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.659651 (+  1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.659652 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.660392 (+   740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.660393 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.660482 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.660485 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.660548 (+    63us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.660607 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":63}
I20260928 13:03:24.660796 10164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.657008 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43463 (local address 127.3.6.1:52329)
0928 13:03:24.657102 (+    94us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.657110 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.657141 (+    31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.657274 (+   133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.657275 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.657279 (+     4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.657388 (+   109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.657390 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.658298 (+   908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.658299 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.659641 (+  1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.659644 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.660392 (+   748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.660393 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.660481 (+    88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.660485 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.660548 (+    63us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.660607 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":155}
I20260928 13:03:24.661151 10384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc283500cf84cf38cfe82c002b4e8e7" candidate_uuid: "e7163ccfb1a14dc38e39e321519b11d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bc8937eb3248c3917c221eed0c318b" is_pre_election: true
I20260928 13:03:24.661363 10384 raft_consensus.cc:2454] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7163ccfb1a14dc38e39e321519b11d6 in term 0.
I20260928 13:03:24.661609 10044 leader_election.cc:302] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3bc8937eb3248c3917c221eed0c318b, e7163ccfb1a14dc38e39e321519b11d6; no voters: 
I20260928 13:03:24.661583 10248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc283500cf84cf38cfe82c002b4e8e7" candidate_uuid: "e7163ccfb1a14dc38e39e321519b11d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778b13b0e7b5462a8445b1b50d5db006" is_pre_election: true
I20260928 13:03:24.661731 10248 raft_consensus.cc:2454] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7163ccfb1a14dc38e39e321519b11d6 in term 0.
I20260928 13:03:24.661722 10464 raft_consensus.cc:2781] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:24.661774 10464 raft_consensus.cc:482] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:24.661803 10464 raft_consensus.cc:3037] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:24.662510 10464 raft_consensus.cc:504] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.662657 10464 leader_election.cc:288] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [CANDIDATE]: Term 1 election: Requested vote from peers 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463), e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257)
I20260928 13:03:24.662781 10248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc283500cf84cf38cfe82c002b4e8e7" candidate_uuid: "e7163ccfb1a14dc38e39e321519b11d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778b13b0e7b5462a8445b1b50d5db006"
I20260928 13:03:24.662815 10384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fdc283500cf84cf38cfe82c002b4e8e7" candidate_uuid: "e7163ccfb1a14dc38e39e321519b11d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3bc8937eb3248c3917c221eed0c318b"
I20260928 13:03:24.662855 10248 raft_consensus.cc:3037] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:24.662918 10384 raft_consensus.cc:3037] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:24.663542 10248 raft_consensus.cc:2454] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7163ccfb1a14dc38e39e321519b11d6 in term 1.
I20260928 13:03:24.663682 10384 raft_consensus.cc:2454] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7163ccfb1a14dc38e39e321519b11d6 in term 1.
I20260928 13:03:24.663715 10047 leader_election.cc:302] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 778b13b0e7b5462a8445b1b50d5db006, e7163ccfb1a14dc38e39e321519b11d6; no voters: 
I20260928 13:03:24.663789 10464 raft_consensus.cc:2781] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:24.663983 10464 raft_consensus.cc:686] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 1 LEADER]: Becoming Leader. State: Replica: e7163ccfb1a14dc38e39e321519b11d6, State: Running, Role: LEADER
I20260928 13:03:24.664191 10464 consensus_queue.cc:237] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:24.665014  9194 catalog_manager.cc:5495] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "e7163ccfb1a14dc38e39e321519b11d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } health_report { overall_health: UNKNOWN } } }
I20260928 13:03:24.668020  9752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.665121 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33538)
0928 13:03:24.665339 (+   218us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:24.665352 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:24.665401 (+    49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:24.665612 (+   211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:24.665613 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:24.665614 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:24.665661 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.665663 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.666485 (+   822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.666486 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.667306 (+   820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:24.667308 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.667855 (+   547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.667856 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:24.667897 (+    41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.667900 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:24.667939 (+    39us) client_negotiation.cc:240] Negotiation successful
0928 13:03:24.667970 (+    31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202}
I20260928 13:03:24.668020 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.665209 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33538 (local address 127.3.6.60:41155)
0928 13:03:24.665249 (+    40us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.665251 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.665458 (+   207us) server_negotiation.cc:407] Connection header received
0928 13:03:24.665489 (+    31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.665490 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.665511 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.665569 (+    58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:24.665735 (+   166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.666419 (+   684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.667379 (+   960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.667776 (+   397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.667840 (+    64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.667889 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.667943 (+    54us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.667972 (+    29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:03:24.668351  9988 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9]   Dedup: 1.7->[1.8-1.9]
I20260928 13:03:24.669130 10017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1f438ab7d7c4c88a69b8c87e0623799. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.669224 10017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: LEARNER
I20260928 13:03:24.669528  9942 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: NON_VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: true } } }
I20260928 13:03:24.669628  9942 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.670009  9942 raft_consensus.cc:1050] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: attempting to promote NON_VOTER 3534549d8c134bc092560b6c7190aba6 to VOTER
I20260928 13:03:24.670145  9942 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:24.670526  9988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 LEARNER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260928 13:03:24.670570  9802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Refusing update from remote peer b1f438ab7d7c4c88a69b8c87e0623799: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260928 13:03:24.670773  9753 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260928 13:03:24.670866  9754 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260928 13:03:24.671478  9753 raft_consensus.cc:2932] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3534549d8c134bc092560b6c7190aba6 (127.3.6.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.671607  9802 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3534549d8c134bc092560b6c7190aba6 (127.3.6.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.671799  9988 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 3534549d8c134bc092560b6c7190aba6 (127.3.6.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672420  9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672446  9941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672497  9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.672515  9941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:03:24.672550  9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672603  9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.672637  9753 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672621 10017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:24.672683  9753 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:24.672693 10017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:03:24.679059 10455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.676977 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53784 (local address 127.3.6.1:46533)
0928 13:03:24.677027 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.677029 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.677036 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:24.677064 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.677065 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.677083 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.677140 (+    57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:24.677233 (+    93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.677678 (+   445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.678367 (+   689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.678553 (+   186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.678611 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.678718 (+   107us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:24.678829 (+   111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:24.678907 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.678925 (+    18us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.678945 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 13:03:24.680785 10384 raft_consensus.cc:1261] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Refusing update from remote peer e7163ccfb1a14dc38e39e321519b11d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:24.680815 10248 raft_consensus.cc:1261] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Refusing update from remote peer e7163ccfb1a14dc38e39e321519b11d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:24.681113 10465 consensus_queue.cc:1035] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:24.681244 10464 consensus_queue.cc:1035] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:24.683781 10471 mvcc.cc:205] Tried to move back new op lower bound from 7334300076769734656 to 7334300076705148928. Current Snapshot: MvccSnapshot[applied={T|T < 7334300076769734656}]
I20260928 13:03:24.685585 10472 mvcc.cc:205] Tried to move back new op lower bound from 7334300076769734656 to 7334300076705148928. Current Snapshot: MvccSnapshot[applied={T|T < 7334300076769734656}]
I20260928 13:03:24.686607 10474 mvcc.cc:205] Tried to move back new op lower bound from 7334300076769734656 to 7334300076705148928. Current Snapshot: MvccSnapshot[applied={T|T < 7334300076769734656}]
I20260928 13:03:24.687230  9194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:24.687321  9194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:24.688817  9194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1f438ab7d7c4c88a69b8c87e0623799: Sending DeleteTablet for 3 replicas of tablet fdc283500cf84cf38cfe82c002b4e8e7
I20260928 13:03:24.689131 10228 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:24 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:43026
I20260928 13:03:24.689319 10091 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:24 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:53778
I20260928 13:03:24.689463 10480 tablet_replica.cc:330] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: stopping tablet replica
I20260928 13:03:24.689528 10364 tablet_service.cc:1514] Processing DeleteTablet for tablet fdc283500cf84cf38cfe82c002b4e8e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:24 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:46566
I20260928 13:03:24.689657 10480 raft_consensus.cc:2229] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:24.689734 10481 tablet_replica.cc:330] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: stopping tablet replica
I20260928 13:03:24.689832 10481 raft_consensus.cc:2229] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:24.689905 10480 raft_consensus.cc:2258] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:24.690205 10483 tablet_replica.cc:330] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: stopping tablet replica
I20260928 13:03:24.690297 10483 raft_consensus.cc:2229] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:24.690310  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9162
I20260928 13:03:24.691056 10480 ts_tablet_manager.cc:1905] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:24.690390 10483 raft_consensus.cc:2258] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:24.689922 10481 raft_consensus.cc:2258] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:24.692168 10483 ts_tablet_manager.cc:1905] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:24.692168 10481 ts_tablet_manager.cc:1905] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:24.693243 10480 ts_tablet_manager.cc:1918] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:24.693358 10480 log.cc:1196] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/fdc283500cf84cf38cfe82c002b4e8e7
I20260928 13:03:24.693699 10480 ts_tablet_manager.cc:1939] T fdc283500cf84cf38cfe82c002b4e8e7 P 778b13b0e7b5462a8445b1b50d5db006: Deleting consensus metadata
I20260928 13:03:24.693703 10481 ts_tablet_manager.cc:1918] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:24.693708 10483 ts_tablet_manager.cc:1918] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:24.693769 10483 log.cc:1196] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/fdc283500cf84cf38cfe82c002b4e8e7
I20260928 13:03:24.693769 10481 log.cc:1196] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/fdc283500cf84cf38cfe82c002b4e8e7
I20260928 13:03:24.694036 10483 ts_tablet_manager.cc:1939] T fdc283500cf84cf38cfe82c002b4e8e7 P e3bc8937eb3248c3917c221eed0c318b: Deleting consensus metadata
I20260928 13:03:24.694036 10481 ts_tablet_manager.cc:1939] T fdc283500cf84cf38cfe82c002b4e8e7 P e7163ccfb1a14dc38e39e321519b11d6: Deleting consensus metadata
W20260928 13:03:24.696089 10318 connection.cc:535] server connection from 127.0.0.1:46566 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 13:03:24.696274 10182 connection.cc:535] server connection from 127.0.0.1:43026 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 13:03:24.696275 10047 connection.cc:535] server connection from 127.0.0.1:53778 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 13:03:24.702695 10443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.689790 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33550 (local address 127.3.6.60:41155)
0928 13:03:24.689828 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.689830 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.694375 (+  4545us) server_negotiation.cc:407] Connection header received
0928 13:03:24.694422 (+    47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.694423 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.694435 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.694486 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.695403 (+   917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.696194 (+   791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.697317 (+  1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.697622 (+   305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.697700 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.699488 (+  1788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.699489 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.699490 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.699496 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.701149 (+  1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.701541 (+   392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.701542 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.701542 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.701595 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.701770 (+   175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.701771 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.701771 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.701876 (+   105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.702008 (+   132us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.702486 (+   478us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.702585 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:24.706100 10445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.698458 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41840 (local address 127.3.6.61:40331)
0928 13:03:24.698495 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.698497 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.698618 (+   121us) server_negotiation.cc:407] Connection header received
0928 13:03:24.698766 (+   148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.698767 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.698785 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.698816 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.699539 (+   723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.700275 (+   736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.701284 (+  1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.701603 (+   319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.701644 (+    41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.703136 (+  1492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.703138 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.703138 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.703145 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.704922 (+  1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.705304 (+   382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.705305 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.705305 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.705356 (+    51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.705592 (+   236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.705594 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.705594 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.705735 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.705828 (+    93us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.705930 (+   102us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.706001 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:24.706549 10161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:24.698263 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33566 (local address 127.3.6.60:41155)
0928 13:03:24.698305 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:24.698307 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:24.698419 (+   112us) server_negotiation.cc:407] Connection header received
0928 13:03:24.698512 (+    93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:24.698513 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:24.698523 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:24.698553 (+    30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:24.699280 (+   727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.700552 (+  1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.701662 (+  1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:24.702271 (+   609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:24.702317 (+    46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:24.703874 (+  1557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:24.703876 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:24.703876 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:24.703882 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:24.705322 (+  1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.705711 (+   389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.705712 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.705713 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.705765 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:24.705957 (+   192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:24.705957 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:24.705958 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:24.706066 (+   108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:24.706130 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:24.706389 (+   259us) server_negotiation.cc:299] Negotiation successful
0928 13:03:24.706462 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:03:25.686168 10490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:25.685904 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:53421)
0928 13:03:25.686026 (+   122us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:25.686113 (+    87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":79,"threads_started":1}
W20260928 13:03:25.686447 10158 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:45131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:25.686486 10491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:25.686158 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:43551)
0928 13:03:25.686383 (+   225us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:25.686448 (+    65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":62,"threads_started":1}
W20260928 13:03:25.686685 10295 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:45131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:25.687669 10492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:25.687481 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:50165)
0928 13:03:25.687593 (+   112us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:25.687637 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":39,"threads_started":1}
W20260928 13:03:25.687963 10431 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:45131 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.189383 10493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f438ab7d7c4c88a69b8c87e0623799)
I20260928 13:03:26.189497 10493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:26.189723 10494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b1f438ab7d7c4c88a69b8c87e0623799)
I20260928 13:03:26.189776 10493 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155)
I20260928 13:03:26.189867 10494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:26.190147 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.189864 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38204)
0928 13:03:26.190048 (+   184us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190102 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":59,"threads_started":1}
W20260928 13:03:26.190353  9776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.190376 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190128 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38210)
0928 13:03:26.190278 (+   150us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190332 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":47,"threads_started":1}
W20260928 13:03:26.190505  9962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.190662 10494 leader_election.cc:288] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61:40331)
I20260928 13:03:26.190934 10499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190838 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38222)
0928 13:03:26.190877 (+    39us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190904 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260928 13:03:26.191051  9962 leader_election.cc:334] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.191133 10495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190842 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38214)
0928 13:03:26.190945 (+   103us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190968 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":66,"threads_started":1}
W20260928 13:03:26.191207  9776 leader_election.cc:334] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.193806 10501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190507 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41856 (local address 127.3.6.61:40331)
0928 13:03:26.190699 (+   192us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:26.190701 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:26.190707 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:26.190723 (+    16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:26.190724 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:26.190732 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:26.190922 (+   190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:26.190950 (+    28us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.191621 (+   671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.192900 (+  1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.193443 (+   543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.193517 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:26.193527 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:26.193685 (+   158us) server_negotiation.cc:299] Negotiation successful
0928 13:03:26.193721 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260928 13:03:26.193885 10498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190202 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33582 (local address 127.3.6.60:41155)
0928 13:03:26.190282 (+    80us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:26.190284 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:26.190292 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:26.190318 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:26.190318 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:26.190329 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:26.190591 (+   262us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:26.190627 (+    36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.191447 (+   820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.192900 (+  1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.193450 (+   550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.193517 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:26.193526 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:26.193685 (+   159us) server_negotiation.cc:299] Negotiation successful
0928 13:03:26.193722 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69,"thread_start_us":45,"threads_started":1}
I20260928 13:03:26.193913 10496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190021 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41155 (local address 127.0.0.1:33582)
0928 13:03:26.190114 (+    93us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190126 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:26.190181 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:26.190453 (+   272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:26.190454 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:26.190457 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:26.190528 (+    71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:26.190530 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.191524 (+   994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.191525 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:26.192807 (+  1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:26.192809 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.193535 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.193536 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:26.193602 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:26.193607 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:26.193672 (+    65us) client_negotiation.cc:240] Negotiation successful
0928 13:03:26.193780 (+   108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"thread_start_us":35,"threads_started":1}
I20260928 13:03:26.193900 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.190345 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:40331 (local address 127.0.0.1:41856)
0928 13:03:26.190440 (+    95us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.190449 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:26.190489 (+    40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:26.190818 (+   329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:26.190819 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:26.190821 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:26.190853 (+    32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:26.190854 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.191689 (+   835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.191691 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:26.192827 (+  1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:26.192830 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:26.193535 (+   705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:26.193536 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:26.193602 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:26.193607 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:26.193672 (+    65us) client_negotiation.cc:240] Negotiation successful
0928 13:03:26.193710 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":42,"threads_started":1}
I20260928 13:03:26.194144  9802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3534549d8c134bc092560b6c7190aba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92fe38e867f443a5bf1a932ba75cdf15" is_pre_election: true
I20260928 13:03:26.194216  9802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3534549d8c134bc092560b6c7190aba6 in term 1.
I20260928 13:03:26.194311  9988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92fe38e867f443a5bf1a932ba75cdf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3534549d8c134bc092560b6c7190aba6" is_pre_election: true
I20260928 13:03:26.194427  9988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fe38e867f443a5bf1a932ba75cdf15 in term 1.
I20260928 13:03:26.194582  9776 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6, 92fe38e867f443a5bf1a932ba75cdf15; no voters: b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:26.194582  9964 leader_election.cc:302] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6, 92fe38e867f443a5bf1a932ba75cdf15; no voters: b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:26.194689 10494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 13:03:26.194729 10494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1f438ab7d7c4c88a69b8c87e0623799)
I20260928 13:03:26.194692 10493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 13:03:26.194758 10494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:03:26.194763 10493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b1f438ab7d7c4c88a69b8c87e0623799)
I20260928 13:03:26.194785 10493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:03:26.195504 10494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:26.195505 10493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:26.195636 10494 leader_election.cc:288] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 election: Requested vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 92fe38e867f443a5bf1a932ba75cdf15 (127.3.6.61:40331)
I20260928 13:03:26.195657 10493 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 election: Requested vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155)
I20260928 13:03:26.195798 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.195718 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38232)
0928 13:03:26.195751 (+    33us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.195775 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260928 13:03:26.195784  9802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3534549d8c134bc092560b6c7190aba6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "92fe38e867f443a5bf1a932ba75cdf15"
I20260928 13:03:26.195868  9802 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3534549d8c134bc092560b6c7190aba6 in current term 2: Already voted for candidate 92fe38e867f443a5bf1a932ba75cdf15 in this term.
I20260928 13:03:26.195932  9988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92fe38e867f443a5bf1a932ba75cdf15" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3534549d8c134bc092560b6c7190aba6"
I20260928 13:03:26.195998  9988 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 92fe38e867f443a5bf1a932ba75cdf15 in current term 2: Already voted for candidate 3534549d8c134bc092560b6c7190aba6 in this term.
I20260928 13:03:26.196171 10496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.195821 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38246)
0928 13:03:26.196121 (+   300us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.196149 (+    28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285}
I20260928 13:03:26.196228 10497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.196071 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38248)
0928 13:03:26.196166 (+    95us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.196186 (+    20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260928 13:03:26.196290  9962 leader_election.cc:334] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.196336  9962 leader_election.cc:302] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6; no voters: 92fe38e867f443a5bf1a932ba75cdf15, b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:26.196400 10494 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 13:03:26.196609 10496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.196536 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38252)
0928 13:03:26.196566 (+    30us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.196589 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260928 13:03:26.196681  9776 leader_election.cc:334] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:26.196718  9776 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92fe38e867f443a5bf1a932ba75cdf15; no voters: 3534549d8c134bc092560b6c7190aba6, b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:26.196777 10493 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 13:03:26.687073 10504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.686790 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:55351)
0928 13:03:26.686948 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.686996 (+    48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":71,"threads_started":1}
I20260928 13:03:26.687256 10505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.687055 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:54125)
0928 13:03:26.687161 (+   106us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.687210 (+    49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":66,"threads_started":1}
I20260928 13:03:26.688485 10506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:26.688263 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:36779)
0928 13:03:26.688405 (+   142us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:26.688442 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260928 13:03:27.687805 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.687621 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:37347)
0928 13:03:27.687731 (+   110us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.687766 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":53,"threads_started":1}
I20260928 13:03:27.687815 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.687509 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:48167)
0928 13:03:27.687647 (+   138us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.687689 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":66,"threads_started":1}
I20260928 13:03:27.689034 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.688841 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:37571)
0928 13:03:27.688958 (+   117us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.688992 (+    34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":53,"threads_started":1}
I20260928 13:03:27.805408 10510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:27.805505 10510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:27.805680 10510 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155)
I20260928 13:03:27.806185 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.805968 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38440)
0928 13:03:27.806094 (+   126us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.806141 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260928 13:03:27.806255  9988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92fe38e867f443a5bf1a932ba75cdf15" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3534549d8c134bc092560b6c7190aba6" is_pre_election: true
I20260928 13:03:27.806406  9988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92fe38e867f443a5bf1a932ba75cdf15 in term 2.
I20260928 13:03:27.806614  9776 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6, 92fe38e867f443a5bf1a932ba75cdf15; no voters: 
I20260928 13:03:27.806669 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.806569 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38456)
0928 13:03:27.806619 (+    50us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.806650 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 13:03:27.806726 10510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260928 13:03:27.806762  9776 leader_election.cc:334] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:27.806770 10510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:27.806835 10510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 2 FOLLOWER]: Advancing to term 3
I20260928 13:03:27.807570 10510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:27.807695 10510 leader_election.cc:288] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 election: Requested vote from peers b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131), 3534549d8c134bc092560b6c7190aba6 (127.3.6.60:41155)
I20260928 13:03:27.807915 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.807803 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38468)
0928 13:03:27.807846 (+    43us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.807892 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260928 13:03:27.807987  9988 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "92fe38e867f443a5bf1a932ba75cdf15" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3534549d8c134bc092560b6c7190aba6"
I20260928 13:03:27.808070  9988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 2 FOLLOWER]: Advancing to term 3
I20260928 13:03:27.808179 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.808105 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38484)
0928 13:03:27.808138 (+    33us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.808161 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260928 13:03:27.808254  9776 leader_election.cc:334] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
I20260928 13:03:27.808745  9988 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92fe38e867f443a5bf1a932ba75cdf15 in term 3.
I20260928 13:03:27.808918  9776 leader_election.cc:302] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3534549d8c134bc092560b6c7190aba6, 92fe38e867f443a5bf1a932ba75cdf15; no voters: b1f438ab7d7c4c88a69b8c87e0623799
I20260928 13:03:27.809000 10510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 13:03:27.809092 10510 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [term 3 LEADER]: Becoming Leader. State: Replica: 92fe38e867f443a5bf1a932ba75cdf15, State: Running, Role: LEADER
I20260928 13:03:27.809145 10510 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } }
I20260928 13:03:27.809475 10513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92fe38e867f443a5bf1a932ba75cdf15. Latest consensus state: current_term: 3 leader_uuid: "92fe38e867f443a5bf1a932ba75cdf15" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:27.809568 10513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:27.809752 10515 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:27.810140 10515 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:27.810226 10515 catalog_manager.cc:1259] Loaded cluster ID: d2537b906a8d44b4b30ad6bfdbcaa5a4
I20260928 13:03:27.810259 10515 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:27.810438 10515 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:27.810540 10515 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Loaded TSK: 0
I20260928 13:03:27.810688 10515 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:27.865779  9791 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:27.867509  9791 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:27.868624 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.868500 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38506)
0928 13:03:27.868555 (+    55us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.868587 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 13:03:27.868753  9988 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [term 3 FOLLOWER]: Refusing update from remote peer 92fe38e867f443a5bf1a932ba75cdf15: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260928 13:03:27.869069 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.868935 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.0.0.1:38516)
0928 13:03:27.868984 (+    49us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.869013 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 13:03:27.869023 10510 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260928 13:03:27.869167  9776 consensus_peers.cc:487] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 -> Peer b1f438ab7d7c4c88a69b8c87e0623799 (127.3.6.62:45131): Couldn't send request to peer b1f438ab7d7c4c88a69b8c87e0623799. Status: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 13:03:27.869675 10517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92fe38e867f443a5bf1a932ba75cdf15. Latest consensus state: current_term: 3 leader_uuid: "92fe38e867f443a5bf1a932ba75cdf15" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:27.869791 10517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:03:27.870246 10510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "92fe38e867f443a5bf1a932ba75cdf15" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:27.870338 10510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:27.870414 10517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "92fe38e867f443a5bf1a932ba75cdf15" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "b1f438ab7d7c4c88a69b8c87e0623799" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 45131 } } peers { permanent_uuid: "92fe38e867f443a5bf1a932ba75cdf15" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 40331 } attrs { promote: false } } peers { permanent_uuid: "3534549d8c134bc092560b6c7190aba6" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41155 } attrs { promote: false } } }
I20260928 13:03:27.870514 10517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3534549d8c134bc092560b6c7190aba6 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:03:27.875705 10523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872250 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:44257 (local address 127.0.0.1:46576)
0928 13:03:27.872782 (+   532us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.872796 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:27.872856 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:27.873014 (+   158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:27.873015 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:27.873017 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:27.873056 (+    39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.873057 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873908 (+   851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.873909 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.874793 (+   884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.874794 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875423 (+   629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875424 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.875487 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.875491 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:27.875568 (+    77us) client_negotiation.cc:240] Negotiation successful
0928 13:03:27.875613 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":84,"threads_started":1}
I20260928 13:03:27.875695 10527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872378 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46576 (local address 127.3.6.3:44257)
0928 13:03:27.872507 (+   129us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:27.872510 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:27.872847 (+   337us) server_negotiation.cc:407] Connection header received
0928 13:03:27.872914 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:27.872915 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:27.872927 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:27.873002 (+    75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:27.873145 (+   143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873828 (+   683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.874877 (+  1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875332 (+   455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875421 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.875435 (+    14us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:27.875576 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:03:27.875618 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":64,"threads_started":1}
I20260928 13:03:27.876020 10511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872149 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46533 (local address 127.0.0.1:53788)
0928 13:03:27.872370 (+   221us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.872381 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:27.872434 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:27.872717 (+   283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:27.872718 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:27.872720 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:27.872776 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.872778 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873721 (+   943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.873723 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.874995 (+  1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.874998 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875788 (+   790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875789 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.875852 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.875855 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:27.875887 (+    32us) client_negotiation.cc:240] Negotiation successful
0928 13:03:27.875937 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"mutex_wait_us":74}
I20260928 13:03:27.876020 10526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872149 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43463 (local address 127.0.0.1:43028)
0928 13:03:27.872385 (+   236us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.872397 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:27.872454 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:27.873085 (+   631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:27.873086 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:27.873088 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:27.873138 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.873140 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873761 (+   621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.873761 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.874995 (+  1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:27.874998 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875800 (+   802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875801 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:27.875862 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.875866 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:27.875924 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:03:27.875953 (+    29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":66,"thread_start_us":82,"threads_started":1}
I20260928 13:03:27.876170 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872231 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43028 (local address 127.3.6.2:43463)
0928 13:03:27.872970 (+   739us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:27.872972 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:27.872981 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:27.873006 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:27.873007 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:27.873016 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:27.873082 (+    66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:27.873189 (+   107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873660 (+   471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875120 (+  1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875688 (+   568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875760 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.875773 (+    13us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:27.876046 (+   273us) server_negotiation.cc:299] Negotiation successful
0928 13:03:27.876090 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":55,"threads_started":1}
I20260928 13:03:27.876325 10364 tablet_service.cc:1467] Processing CreateTablet for tablet 200a8eee8d9545039bed0fd1836fd98f (DEFAULT_TABLE table=test-table [id=626e8b9eb3d94e1c9c19af012839519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:27.876413 10228 tablet_service.cc:1467] Processing CreateTablet for tablet 200a8eee8d9545039bed0fd1836fd98f (DEFAULT_TABLE table=test-table [id=626e8b9eb3d94e1c9c19af012839519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:27.876468 10364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200a8eee8d9545039bed0fd1836fd98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:27.876534 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.872232 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53788 (local address 127.3.6.1:46533)
0928 13:03:27.872598 (+   366us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:27.872600 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:27.872606 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:03:27.872628 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:27.872628 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:27.872638 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:27.872715 (+    77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:27.872850 (+   135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.873632 (+   782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.875119 (+  1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:27.875693 (+   574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:27.876363 (+   670us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:27.876387 (+    24us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:27.876407 (+    20us) server_negotiation.cc:299] Negotiation successful
0928 13:03:27.876454 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":52,"threads_started":1}
I20260928 13:03:27.876547 10228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200a8eee8d9545039bed0fd1836fd98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:27.877599 10529 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Bootstrap starting.
I20260928 13:03:27.877748 10091 tablet_service.cc:1467] Processing CreateTablet for tablet 200a8eee8d9545039bed0fd1836fd98f (DEFAULT_TABLE table=test-table [id=626e8b9eb3d94e1c9c19af012839519f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:27.877883 10091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 200a8eee8d9545039bed0fd1836fd98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:27.878018 10529 tablet_bootstrap.cc:654] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:27.878304 10528 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Bootstrap starting.
I20260928 13:03:27.878561 10529 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: No bootstrap required, opened a new log
I20260928 13:03:27.878623 10529 ts_tablet_manager.cc:1397] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:27.878674 10528 tablet_bootstrap.cc:654] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:27.878769 10529 raft_consensus.cc:348] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.878866 10529 raft_consensus.cc:374] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:27.878909 10529 raft_consensus.cc:729] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3bc8937eb3248c3917c221eed0c318b, State: Initialized, Role: FOLLOWER
I20260928 13:03:27.878983 10529 consensus_queue.cc:260] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.879208 10529 ts_tablet_manager.cc:1428] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:03:27.879464 10533 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: Bootstrap starting.
I20260928 13:03:27.879781 10533 tablet_bootstrap.cc:654] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:27.879544 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.879372 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:58373)
0928 13:03:27.879481 (+   109us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.879511 (+    30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260928 13:03:27.880177 10432 heartbeater.cc:503] Master 127.3.6.61:40331 was elected leader, sending a full tablet report...
I20260928 13:03:27.880306 10528 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: No bootstrap required, opened a new log
I20260928 13:03:27.880359 10528 ts_tablet_manager.cc:1397] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:27.880362 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.880250 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:59505)
0928 13:03:27.880311 (+    61us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.880338 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260928 13:03:27.880501 10528 raft_consensus.cc:348] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.880575 10528 raft_consensus.cc:374] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:27.880632 10528 raft_consensus.cc:729] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778b13b0e7b5462a8445b1b50d5db006, State: Initialized, Role: FOLLOWER
I20260928 13:03:27.880734 10528 consensus_queue.cc:260] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.880944 10528 ts_tablet_manager.cc:1428] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:27.881170 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.881083 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:43235)
0928 13:03:27.881114 (+    31us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.881141 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260928 13:03:27.881191 10533 tablet_bootstrap.cc:492] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: No bootstrap required, opened a new log
I20260928 13:03:27.881243 10533 ts_tablet_manager.cc:1397] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:27.881366 10533 raft_consensus.cc:348] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.881440 10533 raft_consensus.cc:374] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:27.881461 10533 raft_consensus.cc:729] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7163ccfb1a14dc38e39e321519b11d6, State: Initialized, Role: FOLLOWER
I20260928 13:03:27.881510 10533 consensus_queue.cc:260] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:27.881667 10533 ts_tablet_manager.cc:1428] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:27.881686 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.881596 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:43885)
0928 13:03:27.881630 (+    34us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.881657 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260928 13:03:27.881867 10296 heartbeater.cc:503] Master 127.3.6.61:40331 was elected leader, sending a full tablet report...
I20260928 13:03:27.882040 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.881914 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:50421)
0928 13:03:27.881974 (+    60us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.882007 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260928 13:03:27.882323 10159 heartbeater.cc:503] Master 127.3.6.61:40331 was elected leader, sending a full tablet report...
I20260928 13:03:27.882382 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:27.882247 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:46161)
0928 13:03:27.882326 (+    79us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:27.882355 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260928 13:03:27.962419 10297 tablet.cc:2369] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:28.070432 10532 raft_consensus.cc:482] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:28.070559 10532 raft_consensus.cc:504] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:28.071002 10532 leader_election.cc:288] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463), e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
W20260928 13:03:28.071089 10160 tablet.cc:2369] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:28.074791 10524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.071300 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37303 (local address 127.3.6.2:43463)
0928 13:03:28.071358 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:28.071361 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:28.071371 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:28.071401 (+    30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:28.071402 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:28.071415 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:28.071477 (+    62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:28.071705 (+   228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.072457 (+   752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.073922 (+  1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.074435 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.074510 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:28.074521 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:28.074682 (+   161us) server_negotiation.cc:299] Negotiation successful
0928 13:03:28.074720 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 13:03:28.074791 10525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.071304 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:41097 (local address 127.3.6.1:46533)
0928 13:03:28.071369 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:28.071371 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:28.071694 (+   323us) server_negotiation.cc:407] Connection header received
0928 13:03:28.071723 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:28.071724 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:28.071736 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:28.071794 (+    58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:28.071956 (+   162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.072637 (+   681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.073869 (+  1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.074444 (+   575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.074510 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:28.074521 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:28.074682 (+   161us) server_negotiation.cc:299] Negotiation successful
0928 13:03:28.074721 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 13:03:28.074819 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.071189 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46533 (local address 127.3.6.3:41097)
0928 13:03:28.071579 (+   390us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.071591 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:28.071671 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:28.071833 (+   162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:28.071835 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:28.071837 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:28.071873 (+    36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:28.071874 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.072714 (+   840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.072714 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:28.073777 (+  1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:28.073780 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.074526 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.074527 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:28.074595 (+    68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:28.074599 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:28.074663 (+    64us) client_negotiation.cc:240] Negotiation successful
0928 13:03:28.074720 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"mutex_wait_us":177,"thread_start_us":141,"threads_started":1}
I20260928 13:03:28.075094 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.071189 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43463 (local address 127.3.6.3:37303)
0928 13:03:28.071230 (+    41us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.071243 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:28.071295 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:28.071551 (+   256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:28.071553 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:28.071555 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:28.071620 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:28.071622 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.072555 (+   933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.072556 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:28.073837 (+  1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:28.073839 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.074542 (+   703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.074543 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:28.074595 (+    52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:28.074599 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:28.074663 (+    64us) client_negotiation.cc:240] Negotiation successful
0928 13:03:28.074720 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":5}
I20260928 13:03:28.075129 10111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200a8eee8d9545039bed0fd1836fd98f" candidate_uuid: "e3bc8937eb3248c3917c221eed0c318b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7163ccfb1a14dc38e39e321519b11d6" is_pre_election: true
I20260928 13:03:28.075299 10111 raft_consensus.cc:2454] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3bc8937eb3248c3917c221eed0c318b in term 0.
I20260928 13:03:28.075354 10248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200a8eee8d9545039bed0fd1836fd98f" candidate_uuid: "e3bc8937eb3248c3917c221eed0c318b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778b13b0e7b5462a8445b1b50d5db006" is_pre_election: true
I20260928 13:03:28.075464 10248 raft_consensus.cc:2454] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3bc8937eb3248c3917c221eed0c318b in term 0.
I20260928 13:03:28.075569 10317 leader_election.cc:302] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3bc8937eb3248c3917c221eed0c318b, e7163ccfb1a14dc38e39e321519b11d6; no voters: 
I20260928 13:03:28.075702 10532 raft_consensus.cc:2781] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:28.075752 10532 raft_consensus.cc:482] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:28.075776 10532 raft_consensus.cc:3037] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:28.076474 10532 raft_consensus.cc:504] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:28.076630 10532 leader_election.cc:288] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [CANDIDATE]: Term 1 election: Requested vote from peers 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463), e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533)
I20260928 13:03:28.076831 10248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200a8eee8d9545039bed0fd1836fd98f" candidate_uuid: "e3bc8937eb3248c3917c221eed0c318b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778b13b0e7b5462a8445b1b50d5db006"
I20260928 13:03:28.076823 10111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "200a8eee8d9545039bed0fd1836fd98f" candidate_uuid: "e3bc8937eb3248c3917c221eed0c318b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7163ccfb1a14dc38e39e321519b11d6"
I20260928 13:03:28.076913 10248 raft_consensus.cc:3037] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:28.076912 10111 raft_consensus.cc:3037] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:28.077495 10248 raft_consensus.cc:2454] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3bc8937eb3248c3917c221eed0c318b in term 1.
I20260928 13:03:28.077621 10111 raft_consensus.cc:2454] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3bc8937eb3248c3917c221eed0c318b in term 1.
I20260928 13:03:28.077711 10320 leader_election.cc:302] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 778b13b0e7b5462a8445b1b50d5db006, e3bc8937eb3248c3917c221eed0c318b; no voters: 
I20260928 13:03:28.077807 10532 raft_consensus.cc:2781] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:28.077934 10532 raft_consensus.cc:686] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 1 LEADER]: Becoming Leader. State: Replica: e3bc8937eb3248c3917c221eed0c318b, State: Running, Role: LEADER
I20260928 13:03:28.078002 10532 consensus_queue.cc:237] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } }
I20260928 13:03:28.078374 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.078265 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:45019)
0928 13:03:28.078299 (+    34us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.078344 (+    45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260928 13:03:28.078732  9792 catalog_manager.cc:5495] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b reported cstate change: term changed from 0 to 1, leader changed from <none> to e3bc8937eb3248c3917c221eed0c318b (127.3.6.3). New cstate: current_term: 1 leader_uuid: "e3bc8937eb3248c3917c221eed0c318b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3bc8937eb3248c3917c221eed0c318b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 44257 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:28.102792 10527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.100348 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46592 (local address 127.3.6.3:44257)
0928 13:03:28.100409 (+    61us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:28.100411 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:28.100422 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:28.100532 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:28.100533 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:28.100555 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:28.100627 (+    72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:28.100766 (+   139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.101264 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.102020 (+   756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:28.102216 (+   196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:28.102289 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:28.102452 (+   163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:28.102555 (+   103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:28.102637 (+    82us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:28.102678 (+    41us) server_negotiation.cc:299] Negotiation successful
0928 13:03:28.102699 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:03:28.103921 10248 raft_consensus.cc:1261] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Refusing update from remote peer e3bc8937eb3248c3917c221eed0c318b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:28.104025 10111 raft_consensus.cc:1261] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Refusing update from remote peer e3bc8937eb3248c3917c221eed0c318b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:28.104243 10532 consensus_queue.cc:1035] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [LEADER]: Connected to new peer: Peer: permanent_uuid: "778b13b0e7b5462a8445b1b50d5db006" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43463 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:28.104417 10538 consensus_queue.cc:1035] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7163ccfb1a14dc38e39e321519b11d6" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:28.105878 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.105614 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:51083)
0928 13:03:28.105805 (+   191us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.105843 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260928 13:03:28.106192 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.106074 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:52809)
0928 13:03:28.106116 (+    42us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.106158 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260928 13:03:28.106563 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.106460 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:43753)
0928 13:03:28.106502 (+    42us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.106534 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 13:03:28.106902 10508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.106807 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.2:52925)
0928 13:03:28.106846 (+    39us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.106871 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260928 13:03:28.107218 10509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.107129 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.3:51565)
0928 13:03:28.107161 (+    32us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.107190 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260928 13:03:28.107765 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:28.107568 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:45131 (local address 127.3.6.1:39391)
0928 13:03:28.107693 (+   125us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.107737 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:45131: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260928 13:03:28.109536  9790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:28.109627  9790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:28.110809  9790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92fe38e867f443a5bf1a932ba75cdf15: Sending DeleteTablet for 3 replicas of tablet 200a8eee8d9545039bed0fd1836fd98f
I20260928 13:03:28.111212 10091 tablet_service.cc:1514] Processing DeleteTablet for tablet 200a8eee8d9545039bed0fd1836fd98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:28 UTC) from {username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:53788
I20260928 13:03:28.111238 10364 tablet_service.cc:1514] Processing DeleteTablet for tablet 200a8eee8d9545039bed0fd1836fd98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:28 UTC) from {username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:46576
I20260928 13:03:28.111356 10228 tablet_service.cc:1514] Processing DeleteTablet for tablet 200a8eee8d9545039bed0fd1836fd98f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:28 UTC) from {username='oryx', principal='oryx/127.3.6.61@KRBTEST.COM'} at 127.0.0.1:43028
I20260928 13:03:28.111428 10550 tablet_replica.cc:330] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6: stopping tablet replica
I20260928 13:03:28.111475 10550 raft_consensus.cc:2229] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:28.111515 10550 raft_consensus.cc:2258] T 200a8eee8d9545039bed0fd1836fd98f P e7163ccfb1a14dc38e39e321519b11d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:28.111579 10552 tablet_replica.cc:330] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: stopping tablet replica
I20260928 13:03:28.111611 10551 tablet_replica.cc:330] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: stopping tablet replica
I20260928 13:03:28.111641 10552 raft_consensus.cc:2229] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:28.111653 10551 raft_consensus.cc:2229] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:28.111685 10552 raft_consensus.cc:2258] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:28.111733 10551 raft_consensus.cc:2258] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:28.111927  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9939
I20260928 13:03:28.112751 10552 ts_tablet_manager.cc:1905] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:28.114142 10551 ts_tablet_manager.cc:1905] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:28.114524 10552 ts_tablet_manager.cc:1918] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:28.114598 10552 log.cc:1196] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/200a8eee8d9545039bed0fd1836fd98f
I20260928 13:03:28.114826 10552 ts_tablet_manager.cc:1939] T 200a8eee8d9545039bed0fd1836fd98f P 778b13b0e7b5462a8445b1b50d5db006: Deleting consensus metadata
I20260928 13:03:28.115162  9779 catalog_manager.cc:4841] TS 778b13b0e7b5462a8445b1b50d5db006 (127.3.6.2:43463): tablet 200a8eee8d9545039bed0fd1836fd98f (table test-table [id=626e8b9eb3d94e1c9c19af012839519f]) successfully deleted
I20260928 13:03:28.115790 10551 ts_tablet_manager.cc:1918] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:28.115851 10551 log.cc:1196] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/200a8eee8d9545039bed0fd1836fd98f
I20260928 13:03:28.116088 10551 ts_tablet_manager.cc:1939] T 200a8eee8d9545039bed0fd1836fd98f P e3bc8937eb3248c3917c221eed0c318b: Deleting consensus metadata
I20260928 13:03:28.116565  9776 catalog_manager.cc:4841] TS e3bc8937eb3248c3917c221eed0c318b (127.3.6.3:44257): tablet 200a8eee8d9545039bed0fd1836fd98f (table test-table [id=626e8b9eb3d94e1c9c19af012839519f]) successfully deleted
W20260928 13:03:28.118839 10526 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:28.118051 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46533 (local address 127.0.0.1:53800)
0928 13:03:28.118116 (+    65us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:28.118130 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:28.118174 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:28.118782 (+   608us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46533: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":40}
W20260928 13:03:28.119109  9776 catalog_manager.cc:4584] TS e7163ccfb1a14dc38e39e321519b11d6 (127.3.6.1:46533): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 200a8eee8d9545039bed0fd1836fd98f: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46533: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 13:03:28.119298  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10165
I20260928 13:03:28.125303  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10301
I20260928 13:03:28.130554  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9658
I20260928 13:03:28.135629  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 9846
2026-09-28T13:03:28Z chronyd exiting
[       OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6319 ms)
[ RUN      ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:28 dist-test-slave-ddvw krb5kdc[10555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:28 dist-test-slave-ddvw krb5kdc[10555](info): set up 2 sockets
Sep 28 13:03:28 dist-test-slave-ddvw krb5kdc[10555](info): commencing operation
krb5kdc: starting...
W20260928 13:03:29.231729  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.073s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab.
Entry for principal oryx/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab.
I20260928 13:03:29.350097  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:39525
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab
--principal=oryx/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:39525
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:29.436299 10568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:29.436514 10568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:29.436537 10568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:29.437660 10568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:29.437700 10568 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 13:03:29.437713 10568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:29.437726 10568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:29.437737 10568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:29.437749 10568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:29.439271 10568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:39525
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.62.keytab
--principal=oryx/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:39525
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:29.439561 10568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:29.439802 10568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:29.444657 10574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.444693 10573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:29.444804 10568 server_base.cc:1034] running on GCE node
W20260928 13:03:29.444715 10576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:29.445161 10568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:29.445462 10568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:29.446640 10568 hybrid_clock.cc:648] HybridClock initialized: now 1790600609446621 us; error 34 us; skew 500 ppm
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:29.449195 10568 init.cc:377] Logged in from keytab as oryx/127.3.6.62@KRBTEST.COM (short username oryx)
I20260928 13:03:29.449641 10568 webserver.cc:460] Webserver started at http://127.3.6.62:44319/ using document root <none> and password file <none>
I20260928 13:03:29.449913 10568 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:29.449980 10568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:29.450120 10568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:29.451289 10568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "0cb3aa131e65c6deffe54399e6bc1eb0"
server_key_iv: "e73b68dc52c33c04a746bedd2a03ab52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.451645 10568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "0cb3aa131e65c6deffe54399e6bc1eb0"
server_key_iv: "e73b68dc52c33c04a746bedd2a03ab52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.452971 10568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:29.453684 10583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.453917 10568 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:29.454022 10568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "0cb3aa131e65c6deffe54399e6bc1eb0"
server_key_iv: "e73b68dc52c33c04a746bedd2a03ab52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.454104 10568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:29.462895 10568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:29.464887 10568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:29.465044 10568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:29.469753 10568 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:39525
I20260928 13:03:29.469815 10645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:39525 every 8 connection(s)
I20260928 13:03:29.470168 10568 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:29.470835 10646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:29.473150 10646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Bootstrap starting.
I20260928 13:03:29.473744 10646 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:29.474102 10646 log.cc:824] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:29.474763 10646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: No bootstrap required, opened a new log
I20260928 13:03:29.475062  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10568
I20260928 13:03:29.475158  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:29.475361  3096 external_mini_cluster.cc:1428] Setting key 26998039344fecf4d5cf69b3cc96349a
I20260928 13:03:29.477515 10646 raft_consensus.cc:348] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } }
I20260928 13:03:29.477690 10646 raft_consensus.cc:374] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:29.477728 10646 raft_consensus.cc:729] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad99f58c6bd4f02a2bdbbcd49fc4b7b, State: Initialized, Role: FOLLOWER
I20260928 13:03:29.477881 10646 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } }
I20260928 13:03:29.477949 10646 raft_consensus.cc:388] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:29.477970 10646 raft_consensus.cc:482] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:29.478029 10646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:29.478628 10646 raft_consensus.cc:504] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } }
I20260928 13:03:29.478734 10646 leader_election.cc:302] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cad99f58c6bd4f02a2bdbbcd49fc4b7b; no voters: 
I20260928 13:03:29.478883 10646 leader_election.cc:288] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:29.478957 10651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:29.479142 10651 raft_consensus.cc:686] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [term 1 LEADER]: Becoming Leader. State: Replica: cad99f58c6bd4f02a2bdbbcd49fc4b7b, State: Running, Role: LEADER
I20260928 13:03:29.479154 10646 sys_catalog.cc:564] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:29.479249 10651 consensus_queue.cc:237] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } }
I20260928 13:03:29.479604 10651 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [sys.catalog]: SysCatalogTable state changed. Reason: New leader cad99f58c6bd4f02a2bdbbcd49fc4b7b. Latest consensus state: current_term: 1 leader_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } } }
I20260928 13:03:29.479696 10651 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:29.479615 10652 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cad99f58c6bd4f02a2bdbbcd49fc4b7b" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39525 } } }
I20260928 13:03:29.480029 10652 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b [sys.catalog]: This master's current role is: LEADER
W20260928 13:03:29.480880 10666 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:03:29.481897 10666 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:03:29.481979 10660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:29.482189 10660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:29.484151 10660 catalog_manager.cc:1347] Generated new cluster ID: 896006a8ab1149919218d0ef77815b54
I20260928 13:03:29.484201 10660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:29.489176 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.475891 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47726 (local address 127.3.6.62:39525)
0928 13:03:29.476097 (+   206us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.476107 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.476139 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:03:29.477470 (+  1331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.477478 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.477542 (+    64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.477693 (+   151us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.478458 (+   765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.479925 (+  1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.480940 (+  1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.481550 (+   610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.481660 (+   110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.484561 (+  2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:29.484565 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:29.484566 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:29.484580 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:29.487371 (+  2791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.487794 (+   423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.487797 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.487797 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.487923 (+   126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.488175 (+   252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.488176 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.488177 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.488522 (+   345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:29.488693 (+   171us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:29.488774 (+    81us) server_negotiation.cc:299] Negotiation successful
0928 13:03:29.488928 (+   154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":99,"threads_started":1}
I20260928 13:03:29.502671 10660 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:29.503319 10660 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:29.510887 10660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Generated new TSK 0
I20260928 13:03:29.511097 10660 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
I20260928 13:03:29.546739  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:39525
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:29.628811 10672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:29.629035 10672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:29.629061 10672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:29.630239 10672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:29.630283 10672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:29.630303 10672 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:29.630322 10672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:29.631868 10672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:39525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:29.632109 10672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:29.632354 10672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:29.637849 10680 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.637843 10678 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.637930 10677 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:29.638216 10672 server_base.cc:1034] running on GCE node
I20260928 13:03:29.638430 10672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:29.638643 10672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:29.639871 10672 hybrid_clock.cc:648] HybridClock initialized: now 1790600609639859 us; error 37 us; skew 500 ppm
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:29.642460 10672 init.cc:377] Logged in from keytab as oryx/127.3.6.1@KRBTEST.COM (short username oryx)
I20260928 13:03:29.642978 10672 webserver.cc:460] Webserver started at http://127.3.6.1:34753/ using document root <none> and password file <none>
I20260928 13:03:29.643227 10672 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:29.643276 10672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:29.643370 10672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:29.644407 10672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "e8cab9208cd4480eb9610bc21e407d3c"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "af545ca10e6ba9802c28145be8cb24bc"
server_key_iv: "6a11f714d4bb6fba572d8dc4f7f64dad"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.644709 10672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "e8cab9208cd4480eb9610bc21e407d3c"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "af545ca10e6ba9802c28145be8cb24bc"
server_key_iv: "6a11f714d4bb6fba572d8dc4f7f64dad"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.646044 10672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:29.646741 10687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.646927 10672 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:29.647046 10672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "e8cab9208cd4480eb9610bc21e407d3c"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "af545ca10e6ba9802c28145be8cb24bc"
server_key_iv: "6a11f714d4bb6fba572d8dc4f7f64dad"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.647115 10672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:29.661164 10672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:29.663069 10672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:29.663185 10672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:29.663654 10672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:29.663688 10672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.663717 10672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:29.663769 10672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.670297 10672 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:44805
I20260928 13:03:29.670384 10802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:44805 every 8 connection(s)
I20260928 13:03:29.670714 10672 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:29.671839  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10672
I20260928 13:03:29.671974  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:29.672165  3096 external_mini_cluster.cc:1428] Setting key 857e768b244183aa06023e71c2e10e96
I20260928 13:03:29.674867 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.664165 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50789 (local address 127.3.6.62:39525)
0928 13:03:29.664235 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.664238 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.664412 (+   174us) server_negotiation.cc:407] Connection header received
0928 13:03:29.664906 (+   494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.664907 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.664921 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.665008 (+    87us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.665881 (+   873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.666749 (+   868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.668448 (+  1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.668796 (+   348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.668886 (+    90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.671688 (+  2802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:29.671689 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:29.671689 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:29.671696 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:29.673282 (+  1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.673828 (+   546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.673829 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.673829 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.673881 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.674149 (+   268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.674150 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.674150 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.674330 (+   180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:29.674407 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:29.674655 (+   248us) server_negotiation.cc:299] Negotiation successful
0928 13:03:29.674747 (+    92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 13:03:29.674902 10696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.664136 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.1:50789)
0928 13:03:29.664281 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:29.664321 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:29.664817 (+   496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:29.665086 (+   269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:29.665090 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:29.665489 (+   399us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:29.665771 (+   282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.665778 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.666884 (+  1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.666885 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.668335 (+  1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.668338 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.668877 (+   539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.668891 (+    14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.669044 (+   153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.669686 (+   642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:29.669698 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:29.671590 (+  1892us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:29.673359 (+  1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.673366 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.673369 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.673706 (+   337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.673943 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.673944 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.673944 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.674086 (+   142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.674406 (+   320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:29.674411 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:29.674528 (+   117us) client_negotiation.cc:769] Sending connection context
0928 13:03:29.674614 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:03:29.674739 (+   125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":78,"threads_started":1}
I20260928 13:03:29.676360 10803 heartbeater.cc:347] Connected to a master server at 127.3.6.62:39525
I20260928 13:03:29.676442 10803 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:29.676617 10803 heartbeater.cc:511] Master 127.3.6.62:39525 requested a full tablet report, sending...
I20260928 13:03:29.677143 10599 ts_manager.cc:194] Registered new tserver with Master: e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805)
I20260928 13:03:29.677778 10599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:50789
WARNING: no policy specified for oryx/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:03:29.683166 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.676526 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:48919 (local address 127.3.6.62:39525)
0928 13:03:29.676571 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.676573 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.676754 (+   181us) server_negotiation.cc:407] Connection header received
0928 13:03:29.676817 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.676818 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.676830 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.676890 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.677297 (+   407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.678106 (+   809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.679283 (+  1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.679469 (+   186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.679573 (+   104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.680740 (+  1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:29.680741 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:29.680741 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:29.680747 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:29.682079 (+  1332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.682415 (+   336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.682416 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.682417 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.682469 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.682655 (+   186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.682656 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.682656 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.682760 (+   104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:29.682862 (+   102us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:29.682977 (+   115us) server_negotiation.cc:299] Negotiation successful
0928 13:03:29.683071 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:03:29.683176 10810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.676528 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.1:48919)
0928 13:03:29.676693 (+   165us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:29.676704 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:29.676765 (+    61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:29.676901 (+   136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:29.676902 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:29.677088 (+   186us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:29.677151 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.677153 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.678232 (+  1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.678233 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.679189 (+   956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.679192 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.679598 (+   406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.679602 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.679672 (+    70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.680187 (+   515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:29.680192 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:29.680619 (+   427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:29.682158 (+  1539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.682159 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.682160 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.682328 (+   168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.682532 (+   204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.682533 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.682533 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.682589 (+    56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.682827 (+   238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:29.682828 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:29.682871 (+    43us) client_negotiation.cc:769] Sending connection context
0928 13:03:29.682938 (+    67us) client_negotiation.cc:240] Negotiation successful
0928 13:03:29.683067 (+   129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
I20260928 13:03:29.697623  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:39525
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:29.779387 10812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:29.779606 10812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:29.779632 10812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:29.780892 10812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:29.780946 10812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:29.780968 10812 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:29.780987 10812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:29.782527 10812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:39525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:29.782714 10812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:29.782894 10812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:29.787778 10820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.787827 10818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.788005 10817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:29.788033 10812 server_base.cc:1034] running on GCE node
I20260928 13:03:29.788219 10812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:29.788501 10812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:29.789677 10812 hybrid_clock.cc:648] HybridClock initialized: now 1790600609789669 us; error 36 us; skew 500 ppm
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:29.792189 10812 init.cc:377] Logged in from keytab as oryx/127.3.6.2@KRBTEST.COM (short username oryx)
I20260928 13:03:29.792675 10812 webserver.cc:460] Webserver started at http://127.3.6.2:45467/ using document root <none> and password file <none>
I20260928 13:03:29.792922 10812 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:29.792989 10812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:29.793131 10812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:29.794164 10812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "39612eb0157443299a1eec066834ff73"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "061ac94ede15941b85dee982177e963b"
server_key_iv: "abedc4ecfb654ffb229b87ec6d8a3f22"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.794533 10812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "39612eb0157443299a1eec066834ff73"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "061ac94ede15941b85dee982177e963b"
server_key_iv: "abedc4ecfb654ffb229b87ec6d8a3f22"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.795926 10812 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:29.796654 10827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.796811 10812 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:29.796924 10812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "39612eb0157443299a1eec066834ff73"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "061ac94ede15941b85dee982177e963b"
server_key_iv: "abedc4ecfb654ffb229b87ec6d8a3f22"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.796994 10812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:29.824254 10812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:29.826225 10812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:29.826406 10812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:29.826942 10812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:29.827006 10812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.827095 10812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:29.827127 10812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:29.834429 10812 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:37755
I20260928 13:03:29.834692 10942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:37755 every 8 connection(s)
I20260928 13:03:29.834857 10812 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:29.836442 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.827523 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:59815 (local address 127.3.6.62:39525)
0928 13:03:29.827579 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.827581 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.827796 (+   215us) server_negotiation.cc:407] Connection header received
0928 13:03:29.828335 (+   539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.828336 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.828349 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.828395 (+    46us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.829069 (+   674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.829582 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.830602 (+  1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.830843 (+   241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.830932 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.833613 (+  2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:29.833615 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:29.833615 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:29.833623 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:29.835360 (+  1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.835716 (+   356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.835717 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.835717 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.835769 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.835969 (+   200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.835969 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.835969 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.836072 (+   103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:29.836121 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:29.836317 (+   196us) server_negotiation.cc:299] Negotiation successful
0928 13:03:29.836376 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 13:03:29.836658 10836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.827521 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.2:59815)
0928 13:03:29.827665 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:29.827702 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:29.828223 (+   521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:29.828476 (+   253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:29.828480 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:29.828777 (+   297us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:29.828977 (+   200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.828982 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.829679 (+   697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.829681 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.830510 (+   829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.830512 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.830931 (+   419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.830944 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.831120 (+   176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.831636 (+   516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:29.831645 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:29.833517 (+  1872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:29.835441 (+  1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.835445 (+     4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.835447 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.835652 (+   205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.835809 (+   157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.835810 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.835810 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.835897 (+    87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.836112 (+   215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:29.836114 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:29.836222 (+   108us) client_negotiation.cc:769] Sending connection context
0928 13:03:29.836297 (+    75us) client_negotiation.cc:240] Negotiation successful
0928 13:03:29.836417 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260928 13:03:29.837131 10943 heartbeater.cc:347] Connected to a master server at 127.3.6.62:39525
I20260928 13:03:29.837204 10943 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:29.837409 10943 heartbeater.cc:511] Master 127.3.6.62:39525 requested a full tablet report, sending...
I20260928 13:03:29.837788 10600 ts_manager.cc:194] Registered new tserver with Master: 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755)
I20260928 13:03:29.838308 10600 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:59815
I20260928 13:03:29.842574  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10812
I20260928 13:03:29.842718  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:29.842952  3096 external_mini_cluster.cc:1428] Setting key 2c30e364f43fbe31aff4c3a83d54bc11
I20260928 13:03:29.843508 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.838098 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.2:43679)
0928 13:03:29.838232 (+   134us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:29.838243 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:29.838301 (+    58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:29.838463 (+   162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:29.838464 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:29.838620 (+   156us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:29.838696 (+    76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.838697 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.839393 (+   696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.839394 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.839864 (+   470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.839866 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.840167 (+   301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.840169 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.840236 (+    67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.840614 (+   378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:29.840618 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:29.840869 (+   251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:29.842350 (+  1481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.842350 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.842351 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.842503 (+   152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.842746 (+   243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:29.842747 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:29.842748 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:29.842820 (+    72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:29.843234 (+   414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:29.843234 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:29.843270 (+    36us) client_negotiation.cc:769] Sending connection context
0928 13:03:29.843326 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:03:29.843408 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":89,"threads_started":1}
I20260928 13:03:29.843526 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.838173 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:43679 (local address 127.3.6.62:39525)
0928 13:03:29.838215 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.838217 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.838292 (+    75us) server_negotiation.cc:407] Connection header received
0928 13:03:29.838355 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.838356 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.838377 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.838437 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.838769 (+   332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.839313 (+   544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.839944 (+   631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.840113 (+   169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.840160 (+    47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:29.840960 (+   800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:29.840961 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:29.840961 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:29.840966 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:29.842282 (+  1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.842602 (+   320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.842603 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.842604 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.842663 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:29.842895 (+   232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:29.842896 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:29.842896 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:29.843094 (+   198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:29.843153 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:29.843351 (+   198us) server_negotiation.cc:299] Negotiation successful
0928 13:03:29.843437 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
WARNING: no policy specified for oryx/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
I20260928 13:03:29.867372  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:39525
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43577
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:29.948232 10952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:29.948454 10952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:29.948479 10952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:29.949618 10952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:29.949656 10952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:29.949678 10952 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 13:03:29.949695 10952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:29.951318 10952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43577
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.3.6.62:39525
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:29.951526 10952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:29.951711 10952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:29.956712 10952 server_base.cc:1034] running on GCE node
W20260928 13:03:29.956640 10960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.956625 10957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:29.956650 10958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:29.957029 10952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:29.957265 10952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:29.958395 10952 hybrid_clock.cc:648] HybridClock initialized: now 1790600609958385 us; error 27 us; skew 500 ppm
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:29.960770 10952 init.cc:377] Logged in from keytab as oryx/127.3.6.3@KRBTEST.COM (short username oryx)
I20260928 13:03:29.961197 10952 webserver.cc:460] Webserver started at http://127.3.6.3:34293/ using document root <none> and password file <none>
I20260928 13:03:29.961426 10952 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:29.961490 10952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:29.961624 10952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:29.962647 10952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "efc51edc41ca404ca725c6f4d723ab62"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "3357aeb135dc060ad973c966caa907a8"
server_key_iv: "f789edd8623f48f1b6dea1316b342b52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.962996 10952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "efc51edc41ca404ca725c6f4d723ab62"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "3357aeb135dc060ad973c966caa907a8"
server_key_iv: "f789edd8623f48f1b6dea1316b342b52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.964538 10952 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:29.965440 10967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.965641 10952 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:29.965731 10952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "efc51edc41ca404ca725c6f4d723ab62"
format_stamp: "Formatted at 2026-09-28 13:03:29 on dist-test-slave-ddvw"
server_key: "3357aeb135dc060ad973c966caa907a8"
server_key_iv: "f789edd8623f48f1b6dea1316b342b52"
server_key_version: "encryptionkey@0"
I20260928 13:03:29.965834 10952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:29.993311 10952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:29.995187 10952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:29.995298 10952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:29.995735 10952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:29.995769 10952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:29.995791 10952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:29.995810 10952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
Sep 28 13:03:29 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:30.002780 10952 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:37133
I20260928 13:03:30.002851 11082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:37133 every 8 connection(s)
I20260928 13:03:30.003216 10952 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:30.005673 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.996254 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:49813 (local address 127.3.6.62:39525)
0928 13:03:29.996330 (+    76us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:29.996333 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:29.996500 (+   167us) server_negotiation.cc:407] Connection header received
0928 13:03:29.996996 (+   496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:29.996997 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:29.997010 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:29.997085 (+    75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:29.997923 (+   838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.998758 (+   835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.000027 (+  1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.000236 (+   209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.000321 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.002798 (+  2477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:30.002800 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:30.002800 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:30.002807 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:30.004326 (+  1519us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.004738 (+   412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.004739 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.004740 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.004795 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.005047 (+   252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.005048 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.005048 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.005167 (+   119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:30.005238 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.005504 (+   266us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.005579 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:03:30.005880 10976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:29.996221 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.3:49813)
0928 13:03:29.996376 (+   155us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:29.996416 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:29.996907 (+   491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:29.997174 (+   267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:29.997177 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:29.997534 (+   357us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:29.997826 (+   292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.997832 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:29.998856 (+  1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:29.998857 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:29.999861 (+  1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:29.999863 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.000341 (+   478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.000354 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.000487 (+   133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.001029 (+   542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:30.001037 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:30.002706 (+  1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:30.004436 (+  1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.004442 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.004445 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.004665 (+   220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.004869 (+   204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.004870 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.004870 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.004982 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.005230 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:30.005236 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:30.005376 (+   140us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.005482 (+   106us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.005638 (+   156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260928 13:03:30.006318 11083 heartbeater.cc:347] Connected to a master server at 127.3.6.62:39525
I20260928 13:03:30.006421 11083 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:30.006598 11083 heartbeater.cc:511] Master 127.3.6.62:39525 requested a full tablet report, sending...
I20260928 13:03:30.007028 10599 ts_manager.cc:194] Registered new tserver with Master: efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133)
I20260928 13:03:30.007539 10599 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:49813
I20260928 13:03:30.012288  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 10952
I20260928 13:03:30.012372  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:30.012508  3096 external_mini_cluster.cc:1428] Setting key 197d849b1ff62c20f359e34ce0832d82
I20260928 13:03:30.013381  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:30.013445 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.007400 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:47301 (local address 127.3.6.62:39525)
0928 13:03:30.007682 (+   282us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.007684 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.007691 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:30.007708 (+    17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.007709 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.007718 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.007770 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.008088 (+   318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.008553 (+   465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.009225 (+   672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.009437 (+   212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.009515 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.010367 (+   852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:30.010369 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:30.010369 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:30.010376 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:30.011826 (+  1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.012619 (+   793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.012620 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.012620 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.012666 (+    46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.012900 (+   234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.012901 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.012901 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.013046 (+   145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:30.013112 (+    66us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.013263 (+   151us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.013344 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264}
I20260928 13:03:30.013480 11089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.007318 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.3.6.3:47301)
0928 13:03:30.007457 (+   139us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.007467 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.007517 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.007789 (+   272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.007790 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.007957 (+   167us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:30.008017 (+    60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.008018 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.008639 (+   621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.008640 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.009148 (+   508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.009149 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.009517 (+   368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.009520 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.009588 (+    68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.010013 (+   425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:30.010017 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:30.010282 (+   265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:30.011926 (+  1644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.011927 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.011927 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.012089 (+   162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.012759 (+   670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.012760 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.012760 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.012833 (+    73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.013115 (+   282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:30.013115 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:30.013159 (+    44us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.013224 (+    65us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.013323 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":93,"threads_started":1}
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600610, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM: 
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-user@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-user@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 13:03:30.034250 10650 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:30.028702 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47742 (local address 127.3.6.62:39525)
0928 13:03:30.028760 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.028762 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.028817 (+    55us) server_negotiation.cc:407] Connection header received
0928 13:03:30.028841 (+    24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.028842 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.028851 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.028904 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.029476 (+   572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.030023 (+   547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.030740 (+   717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.030968 (+   228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.031100 (+   132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.034132 (+  3032us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47742: BlockingRecv error: recv got EOF from 127.0.0.1:47742 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600610, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:30.041811 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.035126 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47752 (local address 127.3.6.62:39525)
0928 13:03:30.035198 (+    72us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.035200 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.035291 (+    91us) server_negotiation.cc:407] Connection header received
0928 13:03:30.035368 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.035369 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.035378 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.035445 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.035901 (+   456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.036378 (+   477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.037152 (+   774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.037348 (+   196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.037432 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.039580 (+  2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:30.039581 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:30.039581 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:30.039588 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:30.040885 (+  1297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.041190 (+   305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.041191 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.041191 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.041242 (+    51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.041409 (+   167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.041410 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.041410 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.041526 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:30.041623 (+    97us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.041684 (+    61us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.041741 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:03:30.043442 10599 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:30.044978 10599 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:30.051610 11107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047252 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44805 (local address 127.0.0.1:36976)
0928 13:03:30.047864 (+   612us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.047873 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.047918 (+    45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.048176 (+   258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.048177 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.048178 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.048208 (+    30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.048209 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.049475 (+  1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.049476 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.050547 (+  1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.050549 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051344 (+   795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051345 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.051406 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051410 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.051470 (+    60us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.051515 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":86,"threads_started":1}
I20260928 13:03:30.051625 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047504 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36976 (local address 127.3.6.1:44805)
0928 13:03:30.047790 (+   286us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.047794 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.047984 (+   190us) server_negotiation.cc:407] Connection header received
0928 13:03:30.048026 (+    42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.048028 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.048043 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.048112 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.048274 (+   162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.049383 (+  1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.050622 (+  1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051271 (+   649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051345 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051420 (+    75us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.051494 (+    74us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.051531 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":76,"threads_started":1}
I20260928 13:03:30.051818 11106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047223 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37133 (local address 127.0.0.1:39824)
0928 13:03:30.047624 (+   401us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.047664 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.047750 (+    86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.048030 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.048033 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.048036 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.048132 (+    96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.048134 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.049443 (+  1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.049444 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.050581 (+  1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.050584 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051584 (+  1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051585 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.051642 (+    57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051646 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.051695 (+    49us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.051737 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":35,"thread_start_us":80,"threads_started":1}
I20260928 13:03:30.051527 11105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047223 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:37755 (local address 127.0.0.1:56184)
0928 13:03:30.047663 (+   440us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.047675 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.047755 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.048044 (+   289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.048045 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.048047 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.048123 (+    76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.048125 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.049012 (+   887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.049013 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.050260 (+  1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.050263 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051200 (+   937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051201 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.051287 (+    86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051304 (+    17us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.051373 (+    69us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.051433 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":2,"thread_start_us":105,"threads_started":1}
I20260928 13:03:30.052088 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047507 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39824 (local address 127.3.6.3:37133)
0928 13:03:30.047686 (+   179us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.047693 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.047707 (+    14us) server_negotiation.cc:407] Connection header received
0928 13:03:30.047859 (+   152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.047861 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.047876 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.047947 (+    71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.048216 (+   269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.049332 (+  1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.050672 (+  1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051410 (+   738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051489 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051558 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.051918 (+   360us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.051970 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":76,"threads_started":1}
I20260928 13:03:30.052206 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.047445 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56184 (local address 127.3.6.2:37755)
0928 13:03:30.047595 (+   150us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.047600 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.047756 (+   156us) server_negotiation.cc:407] Connection header received
0928 13:03:30.047853 (+    97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.047856 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.047900 (+    44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.047974 (+    74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.048203 (+   229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.048927 (+   724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.050347 (+  1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.051123 (+   776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.051197 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.051270 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.051564 (+   294us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.051613 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260928 13:03:30.052574 10737 tablet_service.cc:1467] Processing CreateTablet for tablet 1833e49035ae481ca4f505470a7e48df (DEFAULT_TABLE table=test-table [id=ea64d35450514d98ac88dec2c9c462b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.052883 10737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1833e49035ae481ca4f505470a7e48df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.055516 11017 tablet_service.cc:1467] Processing CreateTablet for tablet 1833e49035ae481ca4f505470a7e48df (DEFAULT_TABLE table=test-table [id=ea64d35450514d98ac88dec2c9c462b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.055841 11017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1833e49035ae481ca4f505470a7e48df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.056087 11111 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Bootstrap starting.
I20260928 13:03:30.056689 11111 tablet_bootstrap.cc:654] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.056986 11111 log.cc:824] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:30.057745 11111 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: No bootstrap required, opened a new log
I20260928 13:03:30.057827 11111 ts_tablet_manager.cc:1397] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:30.059121 11113 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Bootstrap starting.
I20260928 13:03:30.059624 11113 tablet_bootstrap.cc:654] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.059703 11111 raft_consensus.cc:348] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.059677 10877 tablet_service.cc:1467] Processing CreateTablet for tablet 1833e49035ae481ca4f505470a7e48df (DEFAULT_TABLE table=test-table [id=ea64d35450514d98ac88dec2c9c462b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.059856 11113 log.cc:824] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:30.059857 11111 raft_consensus.cc:374] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.059892 11111 raft_consensus.cc:729] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.060034 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1833e49035ae481ca4f505470a7e48df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.060010 11111 consensus_queue.cc:260] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.060271 11111 ts_tablet_manager.cc:1428] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:30.060288 10803 heartbeater.cc:503] Master 127.3.6.62:39525 was elected leader, sending a full tablet report...
I20260928 13:03:30.062870 11116 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Bootstrap starting.
I20260928 13:03:30.063546 11116 tablet_bootstrap.cc:654] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.063735 11113 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: No bootstrap required, opened a new log
I20260928 13:03:30.063812 11113 ts_tablet_manager.cc:1397] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.000s
I20260928 13:03:30.063867 11116 log.cc:824] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:30.064620 11116 tablet_bootstrap.cc:492] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: No bootstrap required, opened a new log
I20260928 13:03:30.064690 11116 ts_tablet_manager.cc:1397] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:30.065900 11113 raft_consensus.cc:348] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.066088 11113 raft_consensus.cc:374] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.066123 11113 raft_consensus.cc:729] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.066250 11113 consensus_queue.cc:260] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.066521 11113 ts_tablet_manager.cc:1428] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:03:30.066548 11083 heartbeater.cc:503] Master 127.3.6.62:39525 was elected leader, sending a full tablet report...
I20260928 13:03:30.066707 11116 raft_consensus.cc:348] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.066847 11116 raft_consensus.cc:374] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.066900 11116 raft_consensus.cc:729] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39612eb0157443299a1eec066834ff73, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.067034 11116 consensus_queue.cc:260] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.067332 10943 heartbeater.cc:503] Master 127.3.6.62:39525 was elected leader, sending a full tablet report...
I20260928 13:03:30.067600 11116 ts_tablet_manager.cc:1428] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
W20260928 13:03:30.085425 10944 tablet.cc:2369] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:30.171491 10804 tablet.cc:2369] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:03:30.253816 11084 tablet.cc:2369] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:30.314908 11115 raft_consensus.cc:482] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:30.315130 11115 raft_consensus.cc:504] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.315573 11115 leader_election.cc:288] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755), efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133)
I20260928 13:03:30.318406 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.315876 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:34999 (local address 127.3.6.3:37133)
0928 13:03:30.315928 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.315930 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.316041 (+   111us) server_negotiation.cc:407] Connection header received
0928 13:03:30.316120 (+    79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.316121 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.316132 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.316178 (+    46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.316316 (+   138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.316776 (+   460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.317699 (+   923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.318055 (+   356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.318135 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.318146 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.318293 (+   147us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.318325 (+    32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 13:03:30.318435 11121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.315815 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37133 (local address 127.3.6.1:34999)
0928 13:03:30.315953 (+   138us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.315963 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.316053 (+    90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.316179 (+   126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.316179 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.316182 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.316248 (+    66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.316250 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.316867 (+   617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.316868 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.317610 (+   742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.317612 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.318134 (+   522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.318135 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.318213 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.318217 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.318275 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.318318 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":70,"threads_started":1}
I20260928 13:03:30.318424 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.315804 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47869 (local address 127.3.6.2:37755)
0928 13:03:30.315877 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.315880 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.315949 (+    69us) server_negotiation.cc:407] Connection header received
0928 13:03:30.316026 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.316027 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.316043 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.316102 (+    59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.316251 (+   149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.316726 (+   475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.317705 (+   979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.318072 (+   367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.318159 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.318168 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.318318 (+   150us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.318353 (+    35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:30.318452 11120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.315727 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:37755 (local address 127.3.6.1:47869)
0928 13:03:30.315875 (+   148us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.315887 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.315953 (+    66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.316107 (+   154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.316108 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.316110 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.316166 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.316168 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.316824 (+   656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.316825 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.317610 (+   785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.317612 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.318159 (+   547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.318160 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.318245 (+    85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.318248 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.318312 (+    64us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.318356 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":3,"thread_start_us":58,"threads_started":1}
I20260928 13:03:30.318823 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1833e49035ae481ca4f505470a7e48df" candidate_uuid: "e8cab9208cd4480eb9610bc21e407d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62" is_pre_election: true
I20260928 13:03:30.318986 11037 raft_consensus.cc:2454] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8cab9208cd4480eb9610bc21e407d3c in term 0.
I20260928 13:03:30.319002 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1833e49035ae481ca4f505470a7e48df" candidate_uuid: "e8cab9208cd4480eb9610bc21e407d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73" is_pre_election: true
I20260928 13:03:30.319198 10897 raft_consensus.cc:2454] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8cab9208cd4480eb9610bc21e407d3c in term 0.
I20260928 13:03:30.319284 10688 leader_election.cc:302] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8cab9208cd4480eb9610bc21e407d3c, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.319418 11115 raft_consensus.cc:2781] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:30.319473 11115 raft_consensus.cc:482] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:30.319497 11115 raft_consensus.cc:3037] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.320182 11115 raft_consensus.cc:504] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.320322 11115 leader_election.cc:288] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [CANDIDATE]: Term 1 election: Requested vote from peers 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755), efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133)
I20260928 13:03:30.320482 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1833e49035ae481ca4f505470a7e48df" candidate_uuid: "e8cab9208cd4480eb9610bc21e407d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73"
I20260928 13:03:30.320556 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1833e49035ae481ca4f505470a7e48df" candidate_uuid: "e8cab9208cd4480eb9610bc21e407d3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62"
I20260928 13:03:30.320586 10897 raft_consensus.cc:3037] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.320626 11037 raft_consensus.cc:3037] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.321529 11037 raft_consensus.cc:2454] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8cab9208cd4480eb9610bc21e407d3c in term 1.
I20260928 13:03:30.321529 10897 raft_consensus.cc:2454] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8cab9208cd4480eb9610bc21e407d3c in term 1.
I20260928 13:03:30.321717 10690 leader_election.cc:302] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, e8cab9208cd4480eb9610bc21e407d3c; no voters: 
I20260928 13:03:30.321846 11115 raft_consensus.cc:2781] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:30.321988 11115 raft_consensus.cc:686] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 1 LEADER]: Becoming Leader. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Running, Role: LEADER
I20260928 13:03:30.322090 11115 consensus_queue.cc:237] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } }
I20260928 13:03:30.322865 10600 catalog_manager.cc:5495] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c reported cstate change: term changed from 0 to 1, leader changed from <none> to e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1). New cstate: current_term: 1 leader_uuid: "e8cab9208cd4480eb9610bc21e407d3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:30.333556 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.330934 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36992 (local address 127.3.6.1:44805)
0928 13:03:30.331069 (+   135us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.331071 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.331097 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:03:30.331188 (+    91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.331189 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.331211 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.331302 (+    91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.331452 (+   150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.331931 (+   479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.332718 (+   787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.332937 (+   219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.333021 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.333191 (+   170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.333307 (+   116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.333417 (+   110us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.333443 (+    26us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.333466 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260928 13:03:30.335682 10897 raft_consensus.cc:1261] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Refusing update from remote peer e8cab9208cd4480eb9610bc21e407d3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.335681 11037 raft_consensus.cc:1261] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Refusing update from remote peer e8cab9208cd4480eb9610bc21e407d3c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.336062 11115 consensus_queue.cc:1035] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.336221 11122 consensus_queue.cc:1035] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.339053 11126 mvcc.cc:205] Tried to move back new op lower bound from 7334300099931709440 to 7334300099879911424. Current Snapshot: MvccSnapshot[applied={T|T < 7334300099931709440}]
I20260928 13:03:30.339329 11127 mvcc.cc:205] Tried to move back new op lower bound from 7334300099931709440 to 7334300099879911424. Current Snapshot: MvccSnapshot[applied={T|T < 7334300099931709440}]
I20260928 13:03:30.341468 10600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.341553 10600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.342290 10600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Sending DeleteTablet for 3 replicas of tablet 1833e49035ae481ca4f505470a7e48df
I20260928 13:03:30.342629 10737 tablet_service.cc:1514] Processing DeleteTablet for tablet 1833e49035ae481ca4f505470a7e48df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36976
I20260928 13:03:30.342629 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet 1833e49035ae481ca4f505470a7e48df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56184
I20260928 13:03:30.342864 11135 tablet_replica.cc:330] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: stopping tablet replica
I20260928 13:03:30.342871 11017 tablet_service.cc:1514] Processing DeleteTablet for tablet 1833e49035ae481ca4f505470a7e48df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39824
I20260928 13:03:30.342970 11135 raft_consensus.cc:2229] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:30.343132 11135 raft_consensus.cc:2258] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.343403 11136 tablet_replica.cc:330] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: stopping tablet replica
I20260928 13:03:30.343398 10600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:30.343581 10600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:30.343669 11135 ts_tablet_manager.cc:1905] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.343900 11136 raft_consensus.cc:2229] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.344178 11136 raft_consensus.cc:2258] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.344898 10877 tablet_service.cc:1467] Processing CreateTablet for tablet 871b11259e3f47e0becbbdebce00aa33 (DEFAULT_TABLE table=test-table [id=8531568ddd22464d86057472202cd2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.345026 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871b11259e3f47e0becbbdebce00aa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.345057 10737 tablet_service.cc:1467] Processing CreateTablet for tablet 871b11259e3f47e0becbbdebce00aa33 (DEFAULT_TABLE table=test-table [id=8531568ddd22464d86057472202cd2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.345166 10737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871b11259e3f47e0becbbdebce00aa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.345681 11135 ts_tablet_manager.cc:1918] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.345745 11135 log.cc:1196] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/1833e49035ae481ca4f505470a7e48df
I20260928 13:03:30.346010 11135 ts_tablet_manager.cc:1939] T 1833e49035ae481ca4f505470a7e48df P e8cab9208cd4480eb9610bc21e407d3c: Deleting consensus metadata
I20260928 13:03:30.346184 11134 tablet_replica.cc:330] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: stopping tablet replica
I20260928 13:03:30.346282 11134 raft_consensus.cc:2229] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.346397 11134 raft_consensus.cc:2258] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.346411 11116 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Bootstrap starting.
I20260928 13:03:30.346455 11111 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Bootstrap starting.
I20260928 13:03:30.346671 11017 tablet_service.cc:1467] Processing CreateTablet for tablet 871b11259e3f47e0becbbdebce00aa33 (DEFAULT_TABLE table=test-table [id=8531568ddd22464d86057472202cd2a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.346765 11017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 871b11259e3f47e0becbbdebce00aa33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.346797 11116 tablet_bootstrap.cc:654] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.346858 11111 tablet_bootstrap.cc:654] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.347455 11116 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: No bootstrap required, opened a new log
I20260928 13:03:30.347505 11116 ts_tablet_manager.cc:1397] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Time spent bootstrapping tablet: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:30.347666 11116 raft_consensus.cc:348] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.347767 11116 raft_consensus.cc:374] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.347793 11116 raft_consensus.cc:729] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39612eb0157443299a1eec066834ff73, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.347832 11116 consensus_queue.cc:260] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.347944 11116 ts_tablet_manager.cc:1428] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:30.348145 11134 ts_tablet_manager.cc:1905] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.348162 11113 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Bootstrap starting.
I20260928 13:03:30.348615 11113 tablet_bootstrap.cc:654] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.348779 10587 catalog_manager.cc:4841] TS e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805): tablet 1833e49035ae481ca4f505470a7e48df (table test-table [id=ea64d35450514d98ac88dec2c9c462b1]) successfully deleted
I20260928 13:03:30.349225 11136 ts_tablet_manager.cc:1905] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.349612 11113 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: No bootstrap required, opened a new log
I20260928 13:03:30.349663 11113 ts_tablet_manager.cc:1397] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:30.349820 11113 raft_consensus.cc:348] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.349903 11113 raft_consensus.cc:374] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.349931 11113 raft_consensus.cc:729] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.349978 11113 consensus_queue.cc:260] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.350080 11113 ts_tablet_manager.cc:1428] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:30.350591 11134 ts_tablet_manager.cc:1918] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.350713 11134 log.cc:1196] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/1833e49035ae481ca4f505470a7e48df
I20260928 13:03:30.351059 11134 ts_tablet_manager.cc:1939] T 1833e49035ae481ca4f505470a7e48df P 39612eb0157443299a1eec066834ff73: Deleting consensus metadata
I20260928 13:03:30.351142 11136 ts_tablet_manager.cc:1918] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.351225 11136 log.cc:1196] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/1833e49035ae481ca4f505470a7e48df
I20260928 13:03:30.351438 11111 tablet_bootstrap.cc:492] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: No bootstrap required, opened a new log
I20260928 13:03:30.351501 11111 ts_tablet_manager.cc:1397] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.000s
I20260928 13:03:30.351598 11136 ts_tablet_manager.cc:1939] T 1833e49035ae481ca4f505470a7e48df P efc51edc41ca404ca725c6f4d723ab62: Deleting consensus metadata
I20260928 13:03:30.351662 10586 catalog_manager.cc:4841] TS 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755): tablet 1833e49035ae481ca4f505470a7e48df (table test-table [id=ea64d35450514d98ac88dec2c9c462b1]) successfully deleted
I20260928 13:03:30.351670 11111 raft_consensus.cc:348] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.351742 11111 raft_consensus.cc:374] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.351756 11111 raft_consensus.cc:729] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.351838 11111 consensus_queue.cc:260] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.351930 11111 ts_tablet_manager.cc:1428] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.352034 10584 catalog_manager.cc:4841] TS efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133): tablet 1833e49035ae481ca4f505470a7e48df (table test-table [id=ea64d35450514d98ac88dec2c9c462b1]) successfully deleted
I20260928 13:03:30.425740 11119 raft_consensus.cc:482] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:30.425832 11119 raft_consensus.cc:504] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.426170 11119 leader_election.cc:288] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133)
I20260928 13:03:30.429603 11141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.426352 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37133 (local address 127.3.6.2:51107)
0928 13:03:30.426491 (+   139us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.426503 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.426579 (+    76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.426758 (+   179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.426759 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.426760 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.426817 (+    57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.426818 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.427774 (+   956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.427775 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.428576 (+   801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.428579 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.429295 (+   716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.429296 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.429365 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.429370 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.429465 (+    95us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.429511 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260928 13:03:30.429592 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.426414 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:51107 (local address 127.3.6.3:37133)
0928 13:03:30.426459 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.426462 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.426556 (+    94us) server_negotiation.cc:407] Connection header received
0928 13:03:30.426655 (+    99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.426657 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.426667 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.426695 (+    28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.426902 (+   207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.427676 (+   774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.428660 (+   984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.429201 (+   541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.429282 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.429304 (+    22us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.429493 (+   189us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.429531 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:03:30.429956 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871b11259e3f47e0becbbdebce00aa33" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62" is_pre_election: true
I20260928 13:03:30.430081 11037 raft_consensus.cc:2454] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 0.
I20260928 13:03:30.430264 10828 leader_election.cc:302] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.430361 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.426378 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44805 (local address 127.3.6.2:34253)
0928 13:03:30.426493 (+   115us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.426503 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.426561 (+    58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.426721 (+   160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.426722 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.426724 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.426817 (+    93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.426818 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.428605 (+  1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.428606 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.429351 (+   745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.429353 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.430041 (+   688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.430042 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.430120 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.430124 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.430219 (+    95us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.430255 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":54,"threads_started":1}
I20260928 13:03:30.430361 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.426545 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:34253 (local address 127.3.6.1:44805)
0928 13:03:30.426590 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.426592 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.426602 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:30.426631 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.426632 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.426641 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.426702 (+    61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.427813 (+  1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.428501 (+   688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.429439 (+   938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.429930 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.430013 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.430024 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.430234 (+   210us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.430276 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:30.430399 11119 raft_consensus.cc:2781] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:30.430434 11119 raft_consensus.cc:482] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:30.430456 11119 raft_consensus.cc:3037] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.430637 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871b11259e3f47e0becbbdebce00aa33" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c" is_pre_election: true
I20260928 13:03:30.430752 10757 raft_consensus.cc:2454] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 0.
I20260928 13:03:30.431365 11119 raft_consensus.cc:504] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.431509 11119 leader_election.cc:288] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 election: Requested vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133)
I20260928 13:03:30.431646 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871b11259e3f47e0becbbdebce00aa33" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c"
I20260928 13:03:30.431716 10757 raft_consensus.cc:3037] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.431699 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "871b11259e3f47e0becbbdebce00aa33" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62"
I20260928 13:03:30.431763 11037 raft_consensus.cc:3037] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.432324 11037 raft_consensus.cc:2454] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 1.
I20260928 13:03:30.432487 10757 raft_consensus.cc:2454] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 1.
I20260928 13:03:30.432503 10828 leader_election.cc:302] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.432603 11119 raft_consensus.cc:2781] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:30.432734 11119 raft_consensus.cc:686] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 1 LEADER]: Becoming Leader. State: Replica: 39612eb0157443299a1eec066834ff73, State: Running, Role: LEADER
I20260928 13:03:30.432821 11119 consensus_queue.cc:237] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.433578 10600 catalog_manager.cc:5495] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39612eb0157443299a1eec066834ff73 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "39612eb0157443299a1eec066834ff73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } health_report { overall_health: UNKNOWN } } }
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600609, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.62@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:30.472613 11149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.463835 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:39525 (local address 127.0.0.1:47764)
0928 13:03:30.464030 (+   195us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.464041 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.464111 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.464287 (+   176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.464288 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.464738 (+   450us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:30.464811 (+    73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.464814 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.465866 (+  1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.465866 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.466703 (+   837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.466710 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.467472 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.467477 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.467533 (+    56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.468189 (+   656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:30.468194 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:30.469924 (+  1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:30.471615 (+  1691us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.471621 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.471623 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.471859 (+   236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.472060 (+   201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:30.472061 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:30.472061 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:30.472115 (+    54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:30.472360 (+   245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:30.472365 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:30.472405 (+    40us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.472456 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.472546 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":90,"threads_started":1}
I20260928 13:03:30.472734 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.463934 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47764 (local address 127.3.6.62:39525)
0928 13:03:30.464026 (+    92us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.464028 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.464101 (+    73us) server_negotiation.cc:407] Connection header received
0928 13:03:30.464178 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.464179 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.464193 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.464277 (+    84us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.464922 (+   645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.465761 (+   839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.467069 (+  1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.467362 (+   293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.467444 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.470009 (+  2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:30.470011 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:30.470011 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:30.470019 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:30.471540 (+  1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.471934 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.471935 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.471935 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.471994 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.472170 (+   176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.472171 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.472171 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.472300 (+   129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:30.472365 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.472496 (+   131us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.472609 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":62}
I20260928 13:03:30.474557 10600 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:47764:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260928 13:03:30.474758 10600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:30.476147 10737 tablet_service.cc:1467] Processing CreateTablet for tablet 473de301937744fdab709d3719e715d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6086f88c6a8f406ca9e314e95a82bf21]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:30.476156 10877 tablet_service.cc:1467] Processing CreateTablet for tablet 473de301937744fdab709d3719e715d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6086f88c6a8f406ca9e314e95a82bf21]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:30.476301 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473de301937744fdab709d3719e715d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.476301 10737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473de301937744fdab709d3719e715d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.477748 11111 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: Bootstrap starting.
I20260928 13:03:30.477823 11017 tablet_service.cc:1467] Processing CreateTablet for tablet 473de301937744fdab709d3719e715d8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6086f88c6a8f406ca9e314e95a82bf21]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 13:03:30.477947 11017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 473de301937744fdab709d3719e715d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.478066 11111 tablet_bootstrap.cc:654] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.478278 11116 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: Bootstrap starting.
I20260928 13:03:30.478580 11116 tablet_bootstrap.cc:654] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.478578 11111 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: No bootstrap required, opened a new log
I20260928 13:03:30.478626 11111 ts_tablet_manager.cc:1397] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:30.478753 11111 raft_consensus.cc:348] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.478814 11111 raft_consensus.cc:374] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.478832 11111 raft_consensus.cc:729] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.478876 11111 consensus_queue.cc:260] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.478956 11111 ts_tablet_manager.cc:1428] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.479080 11115 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.479172 11115 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.479278 11116 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: No bootstrap required, opened a new log
I20260928 13:03:30.479327 11116 ts_tablet_manager.cc:1397] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: Time spent bootstrapping tablet: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:30.479453 11113 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: Bootstrap starting.
I20260928 13:03:30.479468 11116 raft_consensus.cc:348] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.479548 11116 raft_consensus.cc:374] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.479578 11116 raft_consensus.cc:729] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39612eb0157443299a1eec066834ff73, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.479625 11116 consensus_queue.cc:260] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.479717 11116 ts_tablet_manager.cc:1428] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.479780 11119 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.479856 11113 tablet_bootstrap.cc:654] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.479868 11119 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.480741 11113 tablet_bootstrap.cc:492] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: No bootstrap required, opened a new log
I20260928 13:03:30.480785 11113 ts_tablet_manager.cc:1397] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:30.480953 11113 raft_consensus.cc:348] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.481007 11113 raft_consensus.cc:374] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.481042 11113 raft_consensus.cc:729] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.481091 11113 consensus_queue.cc:260] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.481179 11113 ts_tablet_manager.cc:1428] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.481259 11118 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.481356 11118 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.499512 11118 raft_consensus.cc:482] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:30.499603 11118 raft_consensus.cc:504] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.499948 11118 leader_election.cc:288] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755)
I20260928 13:03:30.502882 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.500179 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:45453 (local address 127.3.6.2:37755)
0928 13:03:30.500229 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.500231 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.500280 (+    49us) server_negotiation.cc:407] Connection header received
0928 13:03:30.500382 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.500384 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.500394 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.500461 (+    67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.500613 (+   152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.501168 (+   555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502148 (+   980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.502520 (+   372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502602 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.502612 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.502776 (+   164us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.502817 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:30.502884 10976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.500103 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:37755 (local address 127.3.6.3:45453)
0928 13:03:30.500203 (+   100us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.500215 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.500309 (+    94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.500463 (+   154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.500464 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.500465 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.500547 (+    82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.500549 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.501250 (+   701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.501251 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.502058 (+   807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.502060 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.502600 (+   540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502601 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.502681 (+    80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.502685 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.502756 (+    71us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.502806 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":18}
I20260928 13:03:30.503206 11153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.500111 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44805 (local address 127.3.6.3:44239)
0928 13:03:30.500287 (+   176us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.500303 (+    16us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.500372 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.500526 (+   154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.500527 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.500529 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:30.500616 (+    87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.500617 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.501254 (+   637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.501255 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.502353 (+  1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.502355 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.502912 (+   557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502913 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.502992 (+    79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.502997 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.503083 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.503127 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":52,"thread_start_us":73,"threads_started":1}
I20260928 13:03:30.503178 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473de301937744fdab709d3719e715d8" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73" is_pre_election: true
I20260928 13:03:30.503275 11109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.500199 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:44239 (local address 127.3.6.1:44805)
0928 13:03:30.500246 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.500248 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.500361 (+   113us) server_negotiation.cc:407] Connection header received
0928 13:03:30.500444 (+    83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.500445 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.500458 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.500526 (+    68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:30.500684 (+   158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.501173 (+   489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502463 (+  1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.502822 (+   359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.502914 (+    92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.502924 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.503165 (+   241us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.503218 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:30.503278 10897 raft_consensus.cc:2454] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 0.
I20260928 13:03:30.503446 10970 leader_election.cc:302] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.503522 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473de301937744fdab709d3719e715d8" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c" is_pre_election: true
I20260928 13:03:30.503582 11118 raft_consensus.cc:2781] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:30.503609 10757 raft_consensus.cc:2454] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 0.
I20260928 13:03:30.503625 11118 raft_consensus.cc:482] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:30.503660 11118 raft_consensus.cc:3037] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.504416 11118 raft_consensus.cc:504] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.504578 11118 leader_election.cc:288] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 election: Requested vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755)
I20260928 13:03:30.504709 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473de301937744fdab709d3719e715d8" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c"
I20260928 13:03:30.504801 10757 raft_consensus.cc:3037] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.505435 10757 raft_consensus.cc:2454] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 1.
I20260928 13:03:30.505594 10971 leader_election.cc:302] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8cab9208cd4480eb9610bc21e407d3c, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.505604 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "473de301937744fdab709d3719e715d8" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73"
I20260928 13:03:30.505693 11118 raft_consensus.cc:2781] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:30.505702 10897 raft_consensus.cc:3037] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.505862 11118 raft_consensus.cc:686] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [term 1 LEADER]: Becoming Leader. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Running, Role: LEADER
I20260928 13:03:30.505939 11118 consensus_queue.cc:237] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.506471 10897 raft_consensus.cc:2454] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 1.
I20260928 13:03:30.506523 11154 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: TxnStatusTablet state changed. Reason: New leader efc51edc41ca404ca725c6f4d723ab62. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.506633 11154 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:30.506912 11156 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 13:03:30.506855 10599 catalog_manager.cc:5495] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3). New cstate: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:30.507170 11156 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 13:03:30.517765 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.514781 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39828 (local address 127.3.6.3:37133)
0928 13:03:30.514830 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.514832 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.515057 (+   225us) server_negotiation.cc:407] Connection header received
0928 13:03:30.515167 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.515168 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.515184 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.515243 (+    59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.515380 (+   137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.515848 (+   468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.517048 (+  1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.517222 (+   174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.517272 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.517473 (+   201us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.517562 (+    89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.517614 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.517693 (+    79us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.517707 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 13:03:30.517961 11149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.514710 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37133 (local address 127.0.0.1:39828)
0928 13:03:30.514975 (+   265us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.514990 (+    15us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.515079 (+    89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.515247 (+   168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.515248 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.515250 (+     2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:30.515309 (+    59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.515311 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.515924 (+   613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.515925 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.516957 (+  1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.516961 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.517291 (+   330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.517294 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.517366 (+    72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.517383 (+    17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.517623 (+   240us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.517630 (+     7us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.517691 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.517756 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107}
I20260928 13:03:30.519084 10897 raft_consensus.cc:1261] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Refusing update from remote peer efc51edc41ca404ca725c6f4d723ab62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.519155 10757 raft_consensus.cc:1261] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Refusing update from remote peer efc51edc41ca404ca725c6f4d723ab62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.519356 11154 consensus_queue.cc:1035] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.519466 11118 consensus_queue.cc:1035] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.520098 11119 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: TxnStatusTablet state changed. Reason: New leader efc51edc41ca404ca725c6f4d723ab62. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.520208 11119 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.520253 11115 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: TxnStatusTablet state changed. Reason: New leader efc51edc41ca404ca725c6f4d723ab62. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.520337 11115 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.521054 11118 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.521144 11118 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:30.521410 11125 mvcc.cc:205] Tried to move back new op lower bound from 7334300100684222464 to 7334300100633612288. Current Snapshot: MvccSnapshot[applied={T|T < 7334300100684222464 or (T in {7334300100684222464})}]
I20260928 13:03:30.521524 11115 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.521600 11115 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P e8cab9208cd4480eb9610bc21e407d3c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.521783 11154 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.521860 11154 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P efc51edc41ca404ca725c6f4d723ab62: This TxnStatusTablet replica's current role is: LEADER
I20260928 13:03:30.522188 11119 tablet_replica.cc:439] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } }
I20260928 13:03:30.522291 11119 tablet_replica.cc:442] T 473de301937744fdab709d3719e715d8 P 39612eb0157443299a1eec066834ff73: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 13:03:30.526063 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.523202 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56194 (local address 127.3.6.2:37755)
0928 13:03:30.523253 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.523256 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.523266 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:30.523358 (+    92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.523359 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.523381 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.523465 (+    84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.523552 (+    87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.524410 (+   858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.525157 (+   747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.525495 (+   338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.525575 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.525676 (+   101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.525829 (+   153us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.525906 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.525926 (+    20us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.525948 (+    22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:03:30.531555 11163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.528692 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37133 (local address 127.3.6.2:35705)
0928 13:03:30.528840 (+   148us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.528850 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.528907 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.529032 (+   125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.529033 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.529034 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:30.529089 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.529090 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.530051 (+   961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.530051 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.530626 (+   575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.530628 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.531173 (+   545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.531176 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.531224 (+    48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.531238 (+    14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.531412 (+   174us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.531414 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.531450 (+    36us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.531484 (+    34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":81,"threads_started":1}
I20260928 13:03:30.531562 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.528759 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:35705 (local address 127.3.6.3:37133)
0928 13:03:30.528807 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.528809 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.528902 (+    93us) server_negotiation.cc:407] Connection header received
0928 13:03:30.528951 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.528952 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.528963 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.529030 (+    67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.529146 (+   116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.529974 (+   828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.530707 (+   733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.531095 (+   388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.531166 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.531312 (+   146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.531350 (+    38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.531410 (+    60us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.531454 (+    44us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.531477 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:03:30.534132 10757 raft_consensus.cc:1261] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Refusing update from remote peer 39612eb0157443299a1eec066834ff73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.534180 11037 raft_consensus.cc:1261] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Refusing update from remote peer 39612eb0157443299a1eec066834ff73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.534396 11119 consensus_queue.cc:1035] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.534567 11142 consensus_queue.cc:1035] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.543318 11108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.540316 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:47303 (local address 127.3.6.2:37755)
0928 13:03:30.540360 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.540362 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.540515 (+   153us) server_negotiation.cc:407] Connection header received
0928 13:03:30.540590 (+    75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.540591 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.540602 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.540657 (+    55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.540839 (+   182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.541313 (+   474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.542324 (+  1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.542664 (+   340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.542727 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.542982 (+   255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.543056 (+    74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.543123 (+    67us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.543185 (+    62us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.543212 (+    27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:03:30.543347 11169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.540281 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:37755 (local address 127.3.6.3:47303)
0928 13:03:30.540453 (+   172us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:30.540461 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:30.540541 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:30.540661 (+   120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:30.540661 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:30.540662 (+     1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 13:03:30.540774 (+   112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.540775 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.541402 (+   627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.541404 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.542246 (+   842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:30.542249 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.542759 (+   510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.542778 (+    19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:30.542869 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.542888 (+    19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.543122 (+   234us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.543124 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:30.543173 (+    49us) client_negotiation.cc:240] Negotiation successful
0928 13:03:30.543228 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":91,"threads_started":1}
I20260928 13:03:30.553011 10600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.553129 10600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47752:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.553746 10600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Sending DeleteTablet for 3 replicas of tablet 871b11259e3f47e0becbbdebce00aa33
I20260928 13:03:30.554139 10737 tablet_service.cc:1514] Processing DeleteTablet for tablet 871b11259e3f47e0becbbdebce00aa33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36976
I20260928 13:03:30.554246 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet 871b11259e3f47e0becbbdebce00aa33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56184
I20260928 13:03:30.554340 11135 tablet_replica.cc:330] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: stopping tablet replica
I20260928 13:03:30.554344 11134 tablet_replica.cc:330] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: stopping tablet replica
I20260928 13:03:30.554402 11135 raft_consensus.cc:2229] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.554430 11134 raft_consensus.cc:2229] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:30.554450 11135 raft_consensus.cc:2258] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.554533 11134 raft_consensus.cc:2258] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.554833 11134 ts_tablet_manager.cc:1905] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.554855 11135 ts_tablet_manager.cc:1905] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.556368 11134 ts_tablet_manager.cc:1918] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:30.556425 11134 log.cc:1196] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/871b11259e3f47e0becbbdebce00aa33
I20260928 13:03:30.556458 11135 ts_tablet_manager.cc:1918] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:30.556510 11135 log.cc:1196] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/871b11259e3f47e0becbbdebce00aa33
I20260928 13:03:30.556639 11134 ts_tablet_manager.cc:1939] T 871b11259e3f47e0becbbdebce00aa33 P 39612eb0157443299a1eec066834ff73: Deleting consensus metadata
I20260928 13:03:30.556759 11135 ts_tablet_manager.cc:1939] T 871b11259e3f47e0becbbdebce00aa33 P e8cab9208cd4480eb9610bc21e407d3c: Deleting consensus metadata
I20260928 13:03:30.556943 10586 catalog_manager.cc:4841] TS 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755): tablet 871b11259e3f47e0becbbdebce00aa33 (table test-table [id=8531568ddd22464d86057472202cd2a7]) successfully deleted
I20260928 13:03:30.557106 10587 catalog_manager.cc:4841] TS e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805): tablet 871b11259e3f47e0becbbdebce00aa33 (table test-table [id=8531568ddd22464d86057472202cd2a7]) successfully deleted
I20260928 13:03:30.557317 11017 tablet_service.cc:1514] Processing DeleteTablet for tablet 871b11259e3f47e0becbbdebce00aa33 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39824
I20260928 13:03:30.557417 11136 tablet_replica.cc:330] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: stopping tablet replica
I20260928 13:03:30.557476 11136 raft_consensus.cc:2229] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.557519 11136 raft_consensus.cc:2258] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.560994 11136 ts_tablet_manager.cc:1905] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.562635 11136 ts_tablet_manager.cc:1918] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:30.562707 11136 log.cc:1196] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/871b11259e3f47e0becbbdebce00aa33
I20260928 13:03:30.562925 11136 ts_tablet_manager.cc:1939] T 871b11259e3f47e0becbbdebce00aa33 P efc51edc41ca404ca725c6f4d723ab62: Deleting consensus metadata
I20260928 13:03:30.563310 10584 catalog_manager.cc:4841] TS efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133): tablet 871b11259e3f47e0becbbdebce00aa33 (table test-table [id=8531568ddd22464d86057472202cd2a7]) successfully deleted
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 13:03:30.593694 10650 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:30.584104 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47778 (local address 127.3.6.62:39525)
0928 13:03:30.584156 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.584158 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.586358 (+  2200us) server_negotiation.cc:407] Connection header received
0928 13:03:30.586455 (+    97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.586456 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.586470 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.586526 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.587461 (+   935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.588273 (+   812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.589564 (+  1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.589866 (+   302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.589948 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.593624 (+  3676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47778: BlockingRecv error: recv got EOF from 127.0.0.1:47778 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Sep 28 13:03:30 dist-test-slave-ddvw krb5kdc[10555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600610, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM
I20260928 13:03:30.604339 10650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.595211 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47786 (local address 127.3.6.62:39525)
0928 13:03:30.595256 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.595258 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.595290 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:03:30.595353 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.595354 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.595364 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.595432 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:30.595988 (+   556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.596800 (+   812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.597821 (+  1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.598141 (+   320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.598221 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.601192 (+  2971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:30.601193 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:30.601193 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:30.601201 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:30.602887 (+  1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.603381 (+   494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.603382 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.603382 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.603442 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:30.603666 (+   224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:30.603667 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:30.603667 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:30.603801 (+   134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:30.603909 (+   108us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.604066 (+   157us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.604143 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:03:30.606031 10600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:30.606190 10600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:30.607905 10877 tablet_service.cc:1467] Processing CreateTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 (DEFAULT_TABLE table=test-table [id=28eb32378c134b1a89a7bdec2a142321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.608043 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031d68b74ba942c0b28c5144b6df9e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.609337 11116 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Bootstrap starting.
I20260928 13:03:30.609359 10737 tablet_service.cc:1467] Processing CreateTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 (DEFAULT_TABLE table=test-table [id=28eb32378c134b1a89a7bdec2a142321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.609475 10737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031d68b74ba942c0b28c5144b6df9e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.609854 11116 tablet_bootstrap.cc:654] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.610721 11017 tablet_service.cc:1467] Processing CreateTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 (DEFAULT_TABLE table=test-table [id=28eb32378c134b1a89a7bdec2a142321]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.610834 11017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 031d68b74ba942c0b28c5144b6df9e11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.611445 11116 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: No bootstrap required, opened a new log
I20260928 13:03:30.611490 11116 ts_tablet_manager.cc:1397] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:30.611655 11116 raft_consensus.cc:348] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.611728 11116 raft_consensus.cc:374] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.611764 11116 raft_consensus.cc:729] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39612eb0157443299a1eec066834ff73, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.611797 11116 consensus_queue.cc:260] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.611884 11116 ts_tablet_manager.cc:1428] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.612107 11111 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Bootstrap starting.
I20260928 13:03:30.612416 11111 tablet_bootstrap.cc:654] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.612643 11113 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Bootstrap starting.
I20260928 13:03:30.613037 11113 tablet_bootstrap.cc:654] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.614531 11111 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: No bootstrap required, opened a new log
I20260928 13:03:30.614579 11111 ts_tablet_manager.cc:1397] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:30.614681 11111 raft_consensus.cc:348] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.614745 11111 raft_consensus.cc:374] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.614764 11111 raft_consensus.cc:729] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.614805 11111 consensus_queue.cc:260] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.614908 11111 ts_tablet_manager.cc:1428] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.615661 11113 tablet_bootstrap.cc:492] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: No bootstrap required, opened a new log
I20260928 13:03:30.615720 11113 ts_tablet_manager.cc:1397] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.000s
I20260928 13:03:30.615906 11113 raft_consensus.cc:348] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.615988 11113 raft_consensus.cc:374] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.616009 11113 raft_consensus.cc:729] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.616055 11113 consensus_queue.cc:260] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.616143 11113 ts_tablet_manager.cc:1428] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.651362 11154 raft_consensus.cc:482] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:30.651477 11154 raft_consensus.cc:504] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.651640 11154 leader_election.cc:288] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755)
I20260928 13:03:30.651877 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "031d68b74ba942c0b28c5144b6df9e11" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c" is_pre_election: true
I20260928 13:03:30.651932 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "031d68b74ba942c0b28c5144b6df9e11" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73" is_pre_election: true
I20260928 13:03:30.651985 10757 raft_consensus.cc:2454] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 0.
I20260928 13:03:30.652021 10897 raft_consensus.cc:2454] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 0.
I20260928 13:03:30.652191 10971 leader_election.cc:302] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e8cab9208cd4480eb9610bc21e407d3c, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.652328 11154 raft_consensus.cc:2781] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:30.652374 11154 raft_consensus.cc:482] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:30.652397 11154 raft_consensus.cc:3037] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.653375 11154 raft_consensus.cc:504] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.653525 11154 leader_election.cc:288] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 election: Requested vote from peers e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805), 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755)
I20260928 13:03:30.653728 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "031d68b74ba942c0b28c5144b6df9e11" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c"
I20260928 13:03:30.653759 10897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "031d68b74ba942c0b28c5144b6df9e11" candidate_uuid: "efc51edc41ca404ca725c6f4d723ab62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39612eb0157443299a1eec066834ff73"
I20260928 13:03:30.653820 10757 raft_consensus.cc:3037] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.653832 10897 raft_consensus.cc:3037] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.654649 10897 raft_consensus.cc:2454] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 1.
I20260928 13:03:30.654697 10757 raft_consensus.cc:2454] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efc51edc41ca404ca725c6f4d723ab62 in term 1.
I20260928 13:03:30.654819 10970 leader_election.cc:302] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.654961 11154 raft_consensus.cc:2781] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:30.655040 11154 raft_consensus.cc:686] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 1 LEADER]: Becoming Leader. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Running, Role: LEADER
I20260928 13:03:30.655115 11154 consensus_queue.cc:237] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } }
I20260928 13:03:30.655699 10599 catalog_manager.cc:5495] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 reported cstate change: term changed from 0 to 1, leader changed from <none> to efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3). New cstate: current_term: 1 leader_uuid: "efc51edc41ca404ca725c6f4d723ab62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:30.672091 11110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:30.668064 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39832 (local address 127.3.6.3:37133)
0928 13:03:30.668123 (+    59us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:30.668125 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:30.668134 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:30.668159 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:30.668160 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:30.668171 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:30.668232 (+    61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:30.668386 (+   154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.669126 (+   740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.671110 (+  1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:30.671394 (+   284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:30.671469 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:30.671657 (+   188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:30.671695 (+    38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:30.671736 (+    41us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:30.671990 (+   254us) server_negotiation.cc:299] Negotiation successful
0928 13:03:30.672016 (+    26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:30.674031 10757 raft_consensus.cc:1261] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Refusing update from remote peer efc51edc41ca404ca725c6f4d723ab62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.674142 10897 raft_consensus.cc:1261] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Refusing update from remote peer efc51edc41ca404ca725c6f4d723ab62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:30.674580 11164 consensus_queue.cc:1035] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.674719 11164 consensus_queue.cc:1035] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:30.678159 10599 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.678246 10599 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:30.679067 10599 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Sending DeleteTablet for 3 replicas of tablet 031d68b74ba942c0b28c5144b6df9e11
I20260928 13:03:30.679508 10737 tablet_service.cc:1514] Processing DeleteTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36976
I20260928 13:03:30.679551 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56184
I20260928 13:03:30.679644 11135 tablet_replica.cc:330] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: stopping tablet replica
I20260928 13:03:30.679698 11135 raft_consensus.cc:2229] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.679734 11135 raft_consensus.cc:2258] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.679790 11134 tablet_replica.cc:330] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: stopping tablet replica
I20260928 13:03:30.679838 11134 raft_consensus.cc:2229] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:30.679869 11134 raft_consensus.cc:2258] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.680167 11017 tablet_service.cc:1514] Processing DeleteTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39824
I20260928 13:03:30.680246 11136 tablet_replica.cc:330] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: stopping tablet replica
I20260928 13:03:30.680284 11136 raft_consensus.cc:2229] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:30.680361 11136 raft_consensus.cc:2258] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:30.680697 10600 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:30.680852 10600 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:30.680884 11135 ts_tablet_manager.cc:1905] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.681269 11136 ts_tablet_manager.cc:1905] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.682466 11135 ts_tablet_manager.cc:1918] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.682518 11135 log.cc:1196] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/031d68b74ba942c0b28c5144b6df9e11
I20260928 13:03:30.682571 11136 ts_tablet_manager.cc:1918] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.682619 11136 log.cc:1196] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/031d68b74ba942c0b28c5144b6df9e11
I20260928 13:03:30.682729 11135 ts_tablet_manager.cc:1939] T 031d68b74ba942c0b28c5144b6df9e11 P e8cab9208cd4480eb9610bc21e407d3c: Deleting consensus metadata
I20260928 13:03:30.682833 11136 ts_tablet_manager.cc:1939] T 031d68b74ba942c0b28c5144b6df9e11 P efc51edc41ca404ca725c6f4d723ab62: Deleting consensus metadata
I20260928 13:03:30.683076 10587 catalog_manager.cc:4841] TS e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805): tablet 031d68b74ba942c0b28c5144b6df9e11 (table test-table [id=28eb32378c134b1a89a7bdec2a142321]) successfully deleted
I20260928 13:03:30.683290 11134 ts_tablet_manager.cc:1905] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:30.684495 11017 tablet_service.cc:1467] Processing CreateTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 (DEFAULT_TABLE table=test-table [id=3a219e0cb0194f999cf6ea40e59c97cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.684600 11017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8725bf35568f4ba1a2b51b6f4796d6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.684604 11134 ts_tablet_manager.cc:1918] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:30.684653 11134 log.cc:1196] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/031d68b74ba942c0b28c5144b6df9e11
I20260928 13:03:30.684845 11134 ts_tablet_manager.cc:1939] T 031d68b74ba942c0b28c5144b6df9e11 P 39612eb0157443299a1eec066834ff73: Deleting consensus metadata
I20260928 13:03:30.685688 11113 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Bootstrap starting.
I20260928 13:03:30.685794 10586 catalog_manager.cc:4841] TS 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755): tablet 031d68b74ba942c0b28c5144b6df9e11 (table test-table [id=28eb32378c134b1a89a7bdec2a142321]) successfully deleted
I20260928 13:03:30.685941 10877 tablet_service.cc:1467] Processing CreateTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 (DEFAULT_TABLE table=test-table [id=3a219e0cb0194f999cf6ea40e59c97cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.685997 11113 tablet_bootstrap.cc:654] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.686029 10877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8725bf35568f4ba1a2b51b6f4796d6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.687142 11116 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Bootstrap starting.
I20260928 13:03:30.687546 11116 tablet_bootstrap.cc:654] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.688074 10737 tablet_service.cc:1467] Processing CreateTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 (DEFAULT_TABLE table=test-table [id=3a219e0cb0194f999cf6ea40e59c97cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:30.688180 10737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8725bf35568f4ba1a2b51b6f4796d6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:30.688192 11116 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: No bootstrap required, opened a new log
I20260928 13:03:30.688232 11116 ts_tablet_manager.cc:1397] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Time spent bootstrapping tablet: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:03:30.688325 11116 raft_consensus.cc:348] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.688381 11116 raft_consensus.cc:374] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.688409 11116 raft_consensus.cc:729] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39612eb0157443299a1eec066834ff73, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.688453 11116 consensus_queue.cc:260] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.688529 11116 ts_tablet_manager.cc:1428] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.689358 11111 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: Bootstrap starting.
I20260928 13:03:30.689638 11111 tablet_bootstrap.cc:654] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:30.690275 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet 031d68b74ba942c0b28c5144b6df9e11 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:30 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56184
I20260928 13:03:30.690326 10584 catalog_manager.cc:4841] TS efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133): tablet 031d68b74ba942c0b28c5144b6df9e11 (table test-table [id=28eb32378c134b1a89a7bdec2a142321]) successfully deleted
I20260928 13:03:30.691114 11111 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: No bootstrap required, opened a new log
I20260928 13:03:30.691169 11111 ts_tablet_manager.cc:1397] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.000s
W20260928 13:03:30.691244 10586 catalog_manager.cc:4808] TS 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755): delete failed for tablet 031d68b74ba942c0b28c5144b6df9e11 because the tablet was not found. No further retry: Not found: Tablet not found: 031d68b74ba942c0b28c5144b6df9e11
I20260928 13:03:30.691267 11111 raft_consensus.cc:348] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.691329 11111 raft_consensus.cc:374] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.691347 11111 raft_consensus.cc:729] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8cab9208cd4480eb9610bc21e407d3c, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.691396 11111 consensus_queue.cc:260] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.691488 11111 ts_tablet_manager.cc:1428] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.691845 11113 tablet_bootstrap.cc:492] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: No bootstrap required, opened a new log
I20260928 13:03:30.691895 11113 ts_tablet_manager.cc:1397] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.000s
I20260928 13:03:30.692004 11113 raft_consensus.cc:348] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.692065 11113 raft_consensus.cc:374] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:30.692081 11113 raft_consensus.cc:729] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efc51edc41ca404ca725c6f4d723ab62, State: Initialized, Role: FOLLOWER
I20260928 13:03:30.692121 11113 consensus_queue.cc:260] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.692220 11113 ts_tablet_manager.cc:1428] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Time spent starting tablet: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:30.979859 11119 raft_consensus.cc:482] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:30.979979 11119 raft_consensus.cc:504] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.980173 11119 leader_election.cc:288] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133), e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805)
I20260928 13:03:30.980418 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8725bf35568f4ba1a2b51b6f4796d6c9" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c" is_pre_election: true
I20260928 13:03:30.980418 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8725bf35568f4ba1a2b51b6f4796d6c9" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62" is_pre_election: true
I20260928 13:03:30.980513 11037 raft_consensus.cc:2454] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 0.
I20260928 13:03:30.980516 10757 raft_consensus.cc:2454] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 0.
I20260928 13:03:30.980692 10831 leader_election.cc:302] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, e8cab9208cd4480eb9610bc21e407d3c; no voters: 
I20260928 13:03:30.980827 11119 raft_consensus.cc:2781] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:30.980880 11119 raft_consensus.cc:482] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:30.980903 11119 raft_consensus.cc:3037] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.981565 11119 raft_consensus.cc:504] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.981712 11119 leader_election.cc:288] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 election: Requested vote from peers efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133), e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805)
I20260928 13:03:30.981971 10757 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8725bf35568f4ba1a2b51b6f4796d6c9" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8cab9208cd4480eb9610bc21e407d3c"
I20260928 13:03:30.981966 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8725bf35568f4ba1a2b51b6f4796d6c9" candidate_uuid: "39612eb0157443299a1eec066834ff73" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "efc51edc41ca404ca725c6f4d723ab62"
I20260928 13:03:30.982053 11037 raft_consensus.cc:3037] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.982053 10757 raft_consensus.cc:3037] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:30.982824 10757 raft_consensus.cc:2454] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 1.
I20260928 13:03:30.982824 11037 raft_consensus.cc:2454] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39612eb0157443299a1eec066834ff73 in term 1.
I20260928 13:03:30.983031 10828 leader_election.cc:302] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39612eb0157443299a1eec066834ff73, efc51edc41ca404ca725c6f4d723ab62; no voters: 
I20260928 13:03:30.983160 11119 raft_consensus.cc:2781] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:30.983242 11119 raft_consensus.cc:686] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 1 LEADER]: Becoming Leader. State: Replica: 39612eb0157443299a1eec066834ff73, State: Running, Role: LEADER
I20260928 13:03:30.983299 11119 consensus_queue.cc:237] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } }
I20260928 13:03:30.983875 10599 catalog_manager.cc:5495] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 reported cstate change: term changed from 0 to 1, leader changed from <none> to 39612eb0157443299a1eec066834ff73 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "39612eb0157443299a1eec066834ff73" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39612eb0157443299a1eec066834ff73" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 37755 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:31.048929 11195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:31.046789 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56208 (local address 127.3.6.2:37755)
0928 13:03:31.046913 (+   124us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:31.046915 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:31.046922 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:03:31.046940 (+    18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:31.046941 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:31.046950 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:31.047003 (+    53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:31.047141 (+   138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:31.047610 (+   469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:31.048356 (+   746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:31.048550 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:31.048601 (+    51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:31.048702 (+   101us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:31.048727 (+    25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:31.048760 (+    33us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:31.048803 (+    43us) server_negotiation.cc:299] Negotiation successful
0928 13:03:31.048818 (+    15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":80,"threads_started":1}
I20260928 13:03:31.051182 10757 raft_consensus.cc:1261] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Refusing update from remote peer 39612eb0157443299a1eec066834ff73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:31.051205 11037 raft_consensus.cc:1261] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Refusing update from remote peer 39612eb0157443299a1eec066834ff73: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:31.051403 11119 consensus_queue.cc:1035] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "efc51edc41ca404ca725c6f4d723ab62" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:31.051527 11167 consensus_queue.cc:1035] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8cab9208cd4480eb9610bc21e407d3c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:31.061530 10600 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:31.061638 10600 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:31.062242 10600 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cad99f58c6bd4f02a2bdbbcd49fc4b7b: Sending DeleteTablet for 3 replicas of tablet 8725bf35568f4ba1a2b51b6f4796d6c9
I20260928 13:03:31.062517 11017 tablet_service.cc:1514] Processing DeleteTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:31 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:39824
I20260928 13:03:31.062516 10737 tablet_service.cc:1514] Processing DeleteTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:31 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36976
I20260928 13:03:31.062618 11135 tablet_replica.cc:330] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c: stopping tablet replica
I20260928 13:03:31.062618 11136 tablet_replica.cc:330] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: stopping tablet replica
I20260928 13:03:31.062667 11135 raft_consensus.cc:2229] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:31.062672 11136 raft_consensus.cc:2229] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:31.062705 11135 raft_consensus.cc:2258] T 8725bf35568f4ba1a2b51b6f4796d6c9 P e8cab9208cd4480eb9610bc21e407d3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:31.062705 11136 raft_consensus.cc:2258] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:31.062839 10877 tablet_service.cc:1514] Processing DeleteTablet for tablet 8725bf35568f4ba1a2b51b6f4796d6c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:31 UTC) from {username='oryx', principal='oryx/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56184
I20260928 13:03:31.062917  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10672
I20260928 13:03:31.062945 11134 tablet_replica.cc:330] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: stopping tablet replica
I20260928 13:03:31.062999 11134 raft_consensus.cc:2229] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:31.063081 11134 raft_consensus.cc:2258] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:31.063699 11134 ts_tablet_manager.cc:1905] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:31.064801 11136 ts_tablet_manager.cc:1905] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:31.065501 11134 ts_tablet_manager.cc:1918] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:31.065572 11134 log.cc:1196] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/8725bf35568f4ba1a2b51b6f4796d6c9
I20260928 13:03:31.065780 11134 ts_tablet_manager.cc:1939] T 8725bf35568f4ba1a2b51b6f4796d6c9 P 39612eb0157443299a1eec066834ff73: Deleting consensus metadata
I20260928 13:03:31.066097 10586 catalog_manager.cc:4841] TS 39612eb0157443299a1eec066834ff73 (127.3.6.2:37755): tablet 8725bf35568f4ba1a2b51b6f4796d6c9 (table test-table [id=3a219e0cb0194f999cf6ea40e59c97cb]) successfully deleted
I20260928 13:03:31.066689 11136 ts_tablet_manager.cc:1918] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 13:03:31.066767 11136 log.cc:1196] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/8725bf35568f4ba1a2b51b6f4796d6c9
I20260928 13:03:31.066972 11136 ts_tablet_manager.cc:1939] T 8725bf35568f4ba1a2b51b6f4796d6c9 P efc51edc41ca404ca725c6f4d723ab62: Deleting consensus metadata
I20260928 13:03:31.067322 10584 catalog_manager.cc:4841] TS efc51edc41ca404ca725c6f4d723ab62 (127.3.6.3:37133): tablet 8725bf35568f4ba1a2b51b6f4796d6c9 (table test-table [id=3a219e0cb0194f999cf6ea40e59c97cb]) successfully deleted
W20260928 13:03:31.069793 10587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:44805 (error 108)
I20260928 13:03:31.069998  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10812
I20260928 13:03:31.070926 11202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:31.070726 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44805 (local address 127.0.0.1:37002)
0928 13:03:31.070828 (+   102us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:31.070889 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:44805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82,"thread_start_us":60,"threads_started":1}
W20260928 13:03:31.071098 10587 catalog_manager.cc:4584] TS e8cab9208cd4480eb9610bc21e407d3c (127.3.6.1:44805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8725bf35568f4ba1a2b51b6f4796d6c9: Network error: Client connection negotiation failed: client connection to 127.3.6.1:44805: connect: Connection refused (error 111)
I20260928 13:03:31.076983  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10952
I20260928 13:03:31.082993  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 10568
2026-09-28T13:03:31Z chronyd exiting
[       OK ] SecurityITest.TestNonDefaultPrincipal (2945 ms)
[ RUN      ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:31 dist-test-slave-ddvw krb5kdc[11205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:31 dist-test-slave-ddvw krb5kdc[11205](info): set up 2 sockets
Sep 28 13:03:31 dist-test-slave-ddvw krb5kdc[11205](info): commencing operation
krb5kdc: starting...
W20260928 13:03:32.151736  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.048s	user 0.001s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:32 dist-test-slave-ddvw krb5kdc[11205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600612, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:32.272418  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34451
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:40641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:34451
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:32.353549 11218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:32.353829 11218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:32.353869 11218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:32.355158 11218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:32.355218 11218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:32.355239 11218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:32.355258 11218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:32.355279 11218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:32.356913 11218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:40641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:34451
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34451
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:32.357205 11218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:32.357446 11218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:32.362284 11226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:32.362282 11224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:32.362386 11218 server_base.cc:1034] running on GCE node
W20260928 13:03:32.362583 11223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:32.362849 11218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:32.363186 11218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:32.364357 11218 hybrid_clock.cc:648] HybridClock initialized: now 1790600612364344 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-28T13:03:32Z chronyd exiting
[       OK ] SecurityITest.TestNonExistentPrincipal (1286 ms)
[ RUN      ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:32 dist-test-slave-ddvw krb5kdc[11231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:32 dist-test-slave-ddvw krb5kdc[11231](info): set up 2 sockets
Sep 28 13:03:32 dist-test-slave-ddvw krb5kdc[11231](info): commencing operation
krb5kdc: starting...
W20260928 13:03:33.411815  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.021s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:33.533784  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36487
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:33.614056 11244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:33.614271 11244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:33.614295 11244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:33.615417 11244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:33.615458 11244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:33.615473 11244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:33.615485 11244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:33.615497 11244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:33.616926 11244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:33.617115 11244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:33.617291 11244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:33.622136 11250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:33.622144 11252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:33.622157 11249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:33.622542 11244 server_base.cc:1034] running on GCE node
I20260928 13:03:33.622795 11244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:33.623149 11244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:33.624346 11244 hybrid_clock.cc:648] HybridClock initialized: now 1790600613624322 us; error 35 us; skew 500 ppm
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:33.632404 11244 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:33.632956 11244 webserver.cc:460] Webserver started at http://127.3.6.62:35693/ using document root <none> and password file <none>
I20260928 13:03:33.633213 11244 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:33.633288 11244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:33.633427 11244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:33.634512 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "f1abe970def845d3ada51fc281dda5c4"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "f1dabfd7845c7c7525a991f40b1f3327"
server_key_iv: "36fd9c0e5e6cc945107a7d014191def9"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.634884 11244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "f1abe970def845d3ada51fc281dda5c4"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "f1dabfd7845c7c7525a991f40b1f3327"
server_key_iv: "36fd9c0e5e6cc945107a7d014191def9"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.636301 11244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:33.637053 11259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:33.637236 11244 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:33.637358 11244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "f1abe970def845d3ada51fc281dda5c4"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "f1dabfd7845c7c7525a991f40b1f3327"
server_key_iv: "36fd9c0e5e6cc945107a7d014191def9"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.637434 11244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:33.649276 11244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:33.651590 11244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:33.651803 11244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:33.656147 11244 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36487
I20260928 13:03:33.656188 11311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36487 every 8 connection(s)
I20260928 13:03:33.656563 11244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:33.657464 11312 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:33.658748  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11244
I20260928 13:03:33.658856  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:33.659062  3096 external_mini_cluster.cc:1428] Setting key dbf095fdae76565f0f83bbde2135190d
I20260928 13:03:33.660550 11312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Bootstrap starting.
I20260928 13:03:33.661177 11312 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:33.661510 11312 log.cc:824] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:33.662309 11312 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: No bootstrap required, opened a new log
I20260928 13:03:33.664693 11312 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:33.664832 11312 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:33.664855 11312 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1abe970def845d3ada51fc281dda5c4, State: Initialized, Role: FOLLOWER
I20260928 13:03:33.664987 11312 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:33.665066 11312 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:33.665123 11312 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:33.665170 11312 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:33.665704 11312 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:33.665843 11312 leader_election.cc:302] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1abe970def845d3ada51fc281dda5c4; no voters: 
I20260928 13:03:33.666014 11312 leader_election.cc:288] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:33.666067 11317 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:33.666239 11317 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 LEADER]: Becoming Leader. State: Replica: f1abe970def845d3ada51fc281dda5c4, State: Running, Role: LEADER
I20260928 13:03:33.666276 11312 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:33.666330 11317 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:33.666779 11318 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1abe970def845d3ada51fc281dda5c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } } }
I20260928 13:03:33.666893 11318 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:33.666778 11319 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1abe970def845d3ada51fc281dda5c4. Latest consensus state: current_term: 1 leader_uuid: "f1abe970def845d3ada51fc281dda5c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } } }
I20260928 13:03:33.667104 11319 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:33.667130 11323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:33.667670 11323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:33.670677 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:33.659566 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60252 (local address 127.3.6.62:36487)
0928 13:03:33.659751 (+   185us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:33.659761 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:33.659795 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:03:33.660319 (+   524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:33.660328 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:33.660389 (+    61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:33.660547 (+   158us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:33.661205 (+   658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.662522 (+  1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.663347 (+   825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.663987 (+   640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.664123 (+   136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:33.667058 (+  2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:33.667064 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:33.667064 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:33.667078 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:33.669137 (+  2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:33.669521 (+   384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:33.669524 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:33.669524 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:33.669611 (+    87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:33.669812 (+   201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:33.669812 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:33.669813 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:33.670060 (+   247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:33.670210 (+   150us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:33.670316 (+   106us) server_negotiation.cc:299] Negotiation successful
0928 13:03:33.670463 (+   147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260928 13:03:33.671736 11323 catalog_manager.cc:1347] Generated new cluster ID: a2194ae5637747029705fa0afd308227
I20260928 13:03:33.671777 11323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:33.692687 11323 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:33.693229 11323 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:33.705570 11323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Generated new TSK 0
I20260928 13:03:33.705756 11323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:33.741374  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:33.830847 11338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:33.831146 11338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:33.831176 11338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:33.832353 11338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:33.832389 11338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:33.832418 11338 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:33.833812 11338 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:33.833998 11338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:33.834180 11338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:33.839308 11346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:33.839326 11344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:33.839295 11343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:33.839582 11338 server_base.cc:1034] running on GCE node
I20260928 13:03:33.839787 11338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:33.839986 11338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:33.841146 11338 hybrid_clock.cc:648] HybridClock initialized: now 1790600613841134 us; error 44 us; skew 500 ppm
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:33.843659 11338 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:33.844089 11338 webserver.cc:460] Webserver started at http://127.3.6.1:41859/ using document root <none> and password file <none>
I20260928 13:03:33.844308 11338 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:33.844352 11338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:33.844496 11338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:33.845562 11338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "2e3a820f4d5b4dbfa8350cea87a9f0cd"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "a45c2da8cb254396b660434ec65f9e5c"
server_key_iv: "0dc48436af260a1abe00cfab73f30650"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.845912 11338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "2e3a820f4d5b4dbfa8350cea87a9f0cd"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "a45c2da8cb254396b660434ec65f9e5c"
server_key_iv: "0dc48436af260a1abe00cfab73f30650"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.847326 11338 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:33.848057 11353 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:33.848245 11338 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:33.848330 11338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "2e3a820f4d5b4dbfa8350cea87a9f0cd"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "a45c2da8cb254396b660434ec65f9e5c"
server_key_iv: "0dc48436af260a1abe00cfab73f30650"
server_key_version: "encryptionkey@0"
I20260928 13:03:33.848400 11338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:33.861344 11338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:33.863263 11338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:33.863415 11338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:33.863641 11338 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:33.863940 11338 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:33.863978 11338 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:33.864027 11338 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:33.864053 11338 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:33.870029 11338 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:34879
I20260928 13:03:33.870198 11466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:34879 every 8 connection(s)
I20260928 13:03:33.870453 11338 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:33.877020  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11338
I20260928 13:03:33.877147  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:33.877327  3096 external_mini_cluster.cc:1428] Setting key 8e760782e10f69bc9c4a6964ec75b476
I20260928 13:03:33.880137 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:33.871244 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:41925 (local address 127.3.6.62:36487)
0928 13:03:33.871286 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:33.871288 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:33.871515 (+   227us) server_negotiation.cc:407] Connection header received
0928 13:03:33.871986 (+   471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:33.871987 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:33.871997 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:33.872045 (+    48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:33.872961 (+   916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.873441 (+   480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.874412 (+   971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.874612 (+   200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.874666 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:33.876892 (+  2226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:33.876895 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:33.876895 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:33.876903 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:33.878709 (+  1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:33.879137 (+   428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:33.879138 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:33.879138 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:33.879204 (+    66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:33.879482 (+   278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:33.879483 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:33.879483 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:33.879608 (+   125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:33.879686 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:33.879961 (+   275us) server_negotiation.cc:299] Negotiation successful
0928 13:03:33.880048 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:33.880370 11469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:33.871221 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:41925)
0928 13:03:33.871367 (+   146us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:33.871402 (+    35us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:33.871882 (+   480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:33.872107 (+   225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:33.872110 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:33.872679 (+   569us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:33.872867 (+   188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:33.872872 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.873518 (+   646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.873518 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:33.874331 (+   813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:33.874333 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:33.874676 (+   343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:33.874686 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:33.874783 (+    97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:33.875363 (+   580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:33.875372 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:33.876760 (+  1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:33.878787 (+  2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:33.878792 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:33.878794 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:33.879072 (+   278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:33.879269 (+   197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:33.879270 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:33.879270 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:33.879404 (+   134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:33.879676 (+   272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:33.879682 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:33.879824 (+   142us) client_negotiation.cc:769] Sending connection context
0928 13:03:33.879933 (+   109us) client_negotiation.cc:240] Negotiation successful
0928 13:03:33.880092 (+   159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260928 13:03:33.880861 11467 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36487
I20260928 13:03:33.880973 11467 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:33.881146 11467 heartbeater.cc:511] Master 127.3.6.62:36487 requested a full tablet report, sending...
I20260928 13:03:33.881659 11276 ts_manager.cc:194] Registered new tserver with Master: 2e3a820f4d5b4dbfa8350cea87a9f0cd (127.3.6.1:34879)
I20260928 13:03:33.882254 11276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:41925
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:33.901609  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:33.986845 11472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:33.987110 11472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:33.987166 11472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:33.988354 11472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:33.988395 11472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:33.988423 11472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:33.989925 11472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:33.990161 11472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:33.990386 11472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:33.995532 11477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:33.995528 11478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:33.995657 11472 server_base.cc:1034] running on GCE node
W20260928 13:03:33.995528 11480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:33.995918 11472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:33.996173 11472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:33.997344 11472 hybrid_clock.cc:648] HybridClock initialized: now 1790600613997322 us; error 33 us; skew 500 ppm
Sep 28 13:03:33 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:33.999869 11472 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:34.000321 11472 webserver.cc:460] Webserver started at http://127.3.6.2:37387/ using document root <none> and password file <none>
I20260928 13:03:34.000496 11472 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.000535 11472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.000622 11472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:34.001611 11472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "91c1161f42474411b34ab42c35231ce5"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "7ac76ec643ff02a6d1355f7bcca303de"
server_key_iv: "f20073509f0c68fae008e103ad103c1a"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.001919 11472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "91c1161f42474411b34ab42c35231ce5"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "7ac76ec643ff02a6d1355f7bcca303de"
server_key_iv: "f20073509f0c68fae008e103ad103c1a"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.003201 11472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:34.003952 11487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.004205 11472 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.004303 11472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "91c1161f42474411b34ab42c35231ce5"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "7ac76ec643ff02a6d1355f7bcca303de"
server_key_iv: "f20073509f0c68fae008e103ad103c1a"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.004362 11472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.013425 11472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.015565 11472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.015681 11472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.015856 11472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:34.016163 11472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:34.016196 11472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.016239 11472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:34.016266 11472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.021813 11472 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:35147
I20260928 13:03:34.021910 11600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:35147 every 8 connection(s)
I20260928 13:03:34.022231 11472 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:34.026628  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11472
I20260928 13:03:34.026727  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:34.027081  3096 external_mini_cluster.cc:1428] Setting key 50ed44ec69d5288cfb1f7551e68929f4
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600613, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:34.032593 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.023049 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:42733 (local address 127.3.6.62:36487)
0928 13:03:34.023098 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.023100 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.023340 (+   240us) server_negotiation.cc:407] Connection header received
0928 13:03:34.023887 (+   547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.023889 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.023901 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.023961 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.024949 (+   988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.025435 (+   486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.026477 (+  1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.026695 (+   218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.026772 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.029562 (+  2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:34.029564 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:34.029564 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:34.029574 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:34.031178 (+  1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.031616 (+   438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.031617 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.031617 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.031679 (+    62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.031922 (+   243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.031923 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.031924 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.032055 (+   131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:34.032131 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:34.032403 (+   272us) server_negotiation.cc:299] Negotiation successful
0928 13:03:34.032494 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:03:34.032809 11603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.022957 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:42733)
0928 13:03:34.023217 (+   260us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.023254 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.023772 (+   518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.024044 (+   272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.024047 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.024632 (+   585us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.024828 (+   196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.024833 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.025539 (+   706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.025542 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.026337 (+   795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.026339 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.026846 (+   507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.026861 (+    15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.027064 (+   203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.027745 (+   681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.027756 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.029464 (+  1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:34.031275 (+  1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:34.031282 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:34.031284 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:34.031525 (+   241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:34.031745 (+   220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:34.031746 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:34.031746 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:34.031856 (+   110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:34.032123 (+   267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:34.032129 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:34.032272 (+   143us) client_negotiation.cc:769] Sending connection context
0928 13:03:34.032384 (+   112us) client_negotiation.cc:240] Negotiation successful
0928 13:03:34.032563 (+   179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":147,"threads_started":1}
I20260928 13:03:34.033612 11601 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36487
I20260928 13:03:34.033699 11601 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:34.033951 11601 heartbeater.cc:511] Master 127.3.6.62:36487 requested a full tablet report, sending...
I20260928 13:03:34.034379 11276 ts_manager.cc:194] Registered new tserver with Master: 91c1161f42474411b34ab42c35231ce5 (127.3.6.2:35147)
I20260928 13:03:34.034770 11276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:42733
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:34.053120  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:34.136520 11606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:34.136731 11606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:34.136754 11606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:34.137931 11606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:34.137974 11606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:34.138000 11606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:34.139446 11606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:34.139691 11606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:34.139925 11606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:34.145422 11612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.145418 11611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.145453 11614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:34.145525 11606 server_base.cc:1034] running on GCE node
I20260928 13:03:34.145903 11606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:34.146157 11606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:34.147344 11606 hybrid_clock.cc:648] HybridClock initialized: now 1790600614147315 us; error 40 us; skew 500 ppm
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:34.149881 11606 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:34.150450 11606 webserver.cc:460] Webserver started at http://127.3.6.3:40955/ using document root <none> and password file <none>
I20260928 13:03:34.150738 11606 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.150828 11606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.150991 11606 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:34.152271 11606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "c7732e3651614ceaa3f08647fb9363d0"
format_stamp: "Formatted at 2026-09-28 13:03:34 on dist-test-slave-ddvw"
server_key: "3596c47ae1a15d94079d0f11048ff5ea"
server_key_iv: "ce3658be7f47628146bf6701ec84a4d1"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.152678 11606 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "c7732e3651614ceaa3f08647fb9363d0"
format_stamp: "Formatted at 2026-09-28 13:03:34 on dist-test-slave-ddvw"
server_key: "3596c47ae1a15d94079d0f11048ff5ea"
server_key_iv: "ce3658be7f47628146bf6701ec84a4d1"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.154127 11606 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:34.154865 11621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.155123 11606 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.155226 11606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "c7732e3651614ceaa3f08647fb9363d0"
format_stamp: "Formatted at 2026-09-28 13:03:34 on dist-test-slave-ddvw"
server_key: "3596c47ae1a15d94079d0f11048ff5ea"
server_key_iv: "ce3658be7f47628146bf6701ec84a4d1"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.155297 11606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.171463 11606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.173295 11606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.173408 11606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.173597 11606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:34.173854 11606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:34.173884 11606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.173907 11606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:34.173920 11606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.179920 11606 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:42865
I20260928 13:03:34.179966 11734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:42865 every 8 connection(s)
I20260928 13:03:34.180294 11606 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:34.181202  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11606
I20260928 13:03:34.181310  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:34.181486  3096 external_mini_cluster.cc:1428] Setting key 1fbcee50cb8b77be2db7253b2ea5dfc0
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:34.189667 11315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.180983 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54141 (local address 127.3.6.62:36487)
0928 13:03:34.181033 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.181048 (+    15us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.181276 (+   228us) server_negotiation.cc:407] Connection header received
0928 13:03:34.182004 (+   728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.182005 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.182021 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.182087 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.183097 (+  1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.183593 (+   496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.184632 (+  1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.184823 (+   191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.184893 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.187053 (+  2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:34.187055 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:34.187055 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:34.187063 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:34.188284 (+  1221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.188707 (+   423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.188708 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.188709 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.188768 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.189020 (+   252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.189021 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.189022 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.189132 (+   110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:34.189209 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:34.189495 (+   286us) server_negotiation.cc:299] Negotiation successful
0928 13:03:34.189572 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:34.189872 11737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.180965 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:54141)
0928 13:03:34.181126 (+   161us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.181168 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.181833 (+   665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.182168 (+   335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.182172 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.182787 (+   615us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.182984 (+   197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.182988 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.183700 (+   712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.183701 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.184527 (+   826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.184529 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.184901 (+   372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.184912 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.185048 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.185596 (+   548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.185604 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.186941 (+  1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:34.188380 (+  1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:34.188386 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:34.188389 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:34.188617 (+   228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:34.188836 (+   219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:34.188837 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:34.188837 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:34.188953 (+   116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:34.189199 (+   246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:34.189205 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:34.189347 (+   142us) client_negotiation.cc:769] Sending connection context
0928 13:03:34.189470 (+   123us) client_negotiation.cc:240] Negotiation successful
0928 13:03:34.189642 (+   172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":93,"threads_started":1}
I20260928 13:03:34.190299 11735 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36487
I20260928 13:03:34.190387 11735 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:34.190529 11735 heartbeater.cc:511] Master 127.3.6.62:36487 requested a full tablet report, sending...
I20260928 13:03:34.190853 11276 ts_manager.cc:194] Registered new tserver with Master: c7732e3651614ceaa3f08647fb9363d0 (127.3.6.3:42865)
I20260928 13:03:34.191238 11276 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:54141
I20260928 13:03:34.193150  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
Entry for principal oryx/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab.
WARNING: no policy specified for oryx/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
Entry for principal oryx/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab.
WARNING: no policy specified for oryx/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
Entry for principal oryx/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab.
I20260928 13:03:34.261556  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11338
I20260928 13:03:34.265976  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11472
I20260928 13:03:34.270143  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11606
I20260928 13:03:34.274330  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11244
I20260928 13:03:34.279428  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36487
--webserver_interface=127.3.6.62
--webserver_port=35693
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36487
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:34.360800 11744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:34.361052 11744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:34.361088 11744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:34.362259 11744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:34.362326 11744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:34.362351 11744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:34.362380 11744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:34.362411 11744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:34.363904 11744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36487
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=35693
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:34.364174 11744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:34.364394 11744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:34.369251 11752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.369220 11750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.369275 11749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:34.369408 11744 server_base.cc:1034] running on GCE node
I20260928 13:03:34.369654 11744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:34.369957 11744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:34.371109 11744 hybrid_clock.cc:648] HybridClock initialized: now 1790600614371081 us; error 44 us; skew 500 ppm
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:34.373729 11744 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:34.374291 11744 webserver.cc:460] Webserver started at http://127.3.6.62:35693/ using document root <none> and password file <none>
I20260928 13:03:34.374549 11744 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.374639 11744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.376168 11744 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.376873 11759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.377048 11744 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:34.377154 11744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "f1abe970def845d3ada51fc281dda5c4"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "f1dabfd7845c7c7525a991f40b1f3327"
server_key_iv: "36fd9c0e5e6cc945107a7d014191def9"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.377540 11744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.403177 11744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.406109 11744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.406309 11744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.410868 11744 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36487
I20260928 13:03:34.410920 11811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36487 every 8 connection(s)
I20260928 13:03:34.411386 11744 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:34.412936 11812 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:03:34.413547 11812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Bootstrap starting.
I20260928 13:03:34.414224  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11744
I20260928 13:03:34.414537  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:34879
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:36487
--webserver_port=41859
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:03:34.423266 11812 log.cc:824] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:34.425784 11812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:03:34.426151 11812 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Bootstrap complete.
I20260928 13:03:34.429849 11812 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:34.430191 11812 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1abe970def845d3ada51fc281dda5c4, State: Initialized, Role: FOLLOWER
I20260928 13:03:34.430361 11812 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:34.430439 11812 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:34.430485 11812 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:34.430524 11812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:03:34.431962 11812 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:34.432091 11812 leader_election.cc:302] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1abe970def845d3ada51fc281dda5c4; no voters: 
I20260928 13:03:34.432269 11812 leader_election.cc:288] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260928 13:03:34.432407 11816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 13:03:34.432540 11812 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:34.432579 11816 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [term 2 LEADER]: Becoming Leader. State: Replica: f1abe970def845d3ada51fc281dda5c4, State: Running, Role: LEADER
I20260928 13:03:34.432677 11816 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } }
I20260928 13:03:34.433033 11817 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f1abe970def845d3ada51fc281dda5c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } } }
I20260928 13:03:34.433112 11817 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:34.433368 11818 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1abe970def845d3ada51fc281dda5c4. Latest consensus state: current_term: 2 leader_uuid: "f1abe970def845d3ada51fc281dda5c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1abe970def845d3ada51fc281dda5c4" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36487 } } }
I20260928 13:03:34.433504 11818 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:34.433629 11825 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:34.434216 11825 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:34.434370 11825 catalog_manager.cc:1259] Loaded cluster ID: a2194ae5637747029705fa0afd308227
I20260928 13:03:34.434420 11825 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:34.435364 11825 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:34.435559 11825 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f1abe970def845d3ada51fc281dda5c4: Loaded TSK: 0
I20260928 13:03:34.435786 11825 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 13:03:34.514407 11814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:34.514639 11814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:34.514679 11814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:34.515919 11814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:34.515995 11814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:34.516041 11814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:34.517477 11814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.1.keytab
--principal=oryx/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:34879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=41859
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:34.517747 11814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:34.517998 11814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:34.523967 11839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.524006 11838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.524022 11841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:34.524224 11814 server_base.cc:1034] running on GCE node
I20260928 13:03:34.524375 11814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:34.524570 11814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:34.525732 11814 hybrid_clock.cc:648] HybridClock initialized: now 1790600614525717 us; error 30 us; skew 500 ppm
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:34.528453 11814 init.cc:377] Logged in from keytab as oryx/127.3.6.1@KRBTEST.COM (short username oryx)
I20260928 13:03:34.528982 11814 webserver.cc:460] Webserver started at http://127.3.6.1:41859/ using document root <none> and password file <none>
I20260928 13:03:34.529247 11814 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.529330 11814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.530764 11814 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.531579 11848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.531754 11814 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:03:34.531853 11814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "2e3a820f4d5b4dbfa8350cea87a9f0cd"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "a45c2da8cb254396b660434ec65f9e5c"
server_key_iv: "0dc48436af260a1abe00cfab73f30650"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.532199 11814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.545300 11814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.547714 11814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.547870 11814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.548102 11814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:34.548449 11814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:34.548483 11814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.548506 11814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:34.548519 11814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.556224 11814 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:34879
I20260928 13:03:34.556267 11961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:34879 every 8 connection(s)
I20260928 13:03:34.556631 11814 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:34.563146  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11814
I20260928 13:03:34.563448  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:35147
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:36487
--webserver_port=37387
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.566360 11964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.557410 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:43497)
0928 13:03:34.557599 (+   189us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.557647 (+    48us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.558142 (+   495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.558593 (+   451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.558596 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.559252 (+   656us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.559475 (+   223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.559480 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.561121 (+  1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.561122 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.561941 (+   819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.561943 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.562731 (+   788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.562742 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.562843 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.563448 (+   605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.563456 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.566171 (+  2715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":81,"threads_started":1}
W20260928 13:03:34.566512 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.557475 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43497 (local address 127.3.6.62:36487)
0928 13:03:34.557685 (+   210us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.557693 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.557739 (+    46us) server_negotiation.cc:407] Connection header received
0928 13:03:34.558351 (+   612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.558358 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.558412 (+    54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.558550 (+   138us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.559585 (+  1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.561005 (+  1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.562032 (+  1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.562650 (+   618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.562757 (+   107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.566323 (+  3566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:43497: BlockingRecv error: recv got EOF from 127.3.6.1:43497 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":119,"threads_started":1}
W20260928 13:03:34.566630 11962 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36487 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.6.62:36487: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.572371 11964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.566827 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:43615)
0928 13:03:34.566864 (+    37us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.566873 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.566904 (+    31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.567056 (+   152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.567057 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.567199 (+   142us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.567253 (+    54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.567255 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.568230 (+   975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.568231 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.569104 (+   873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.569107 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.569619 (+   512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.569622 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.569683 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.570218 (+   535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.570224 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.572301 (+  2077us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":24}
W20260928 13:03:34.572763 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.566876 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43615 (local address 127.3.6.62:36487)
0928 13:03:34.566911 (+    35us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.566913 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.566925 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:34.566953 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.566954 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.566966 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.567051 (+    85us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.567338 (+   287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.568136 (+   798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.569195 (+  1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.569534 (+   339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.569614 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.572679 (+  3065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:43615: BlockingRecv error: recv got EOF from 127.3.6.1:43615 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.577955 11964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.572582 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:46293)
0928 13:03:34.572840 (+   258us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.572849 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.572885 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.573127 (+   242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.573127 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.573260 (+   133us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.573291 (+    31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.573292 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.574249 (+   957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.574250 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.575077 (+   827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.575080 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.575549 (+   469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.575553 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.575604 (+    51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.576055 (+   451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.576060 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.577885 (+  1825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":80,"threads_started":1}
W20260928 13:03:34.578056 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.572737 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:46293 (local address 127.3.6.62:36487)
0928 13:03:34.573001 (+   264us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.573004 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.573014 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:34.573036 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.573037 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.573048 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.573115 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.573368 (+   253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.574165 (+   797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.575170 (+  1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.575471 (+   301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.575537 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.577990 (+  2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:46293: BlockingRecv error: recv got EOF from 127.3.6.1:46293 (error 108)
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":69,"threads_started":1}
W20260928 13:03:34.578349 11962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:03:34.647269 11966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:34.647471 11966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:34.647493 11966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:34.648736 11966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:34.648788 11966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:34.648847 11966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:34.650326 11966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.2.keytab
--principal=oryx/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:35147
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=37387
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:34.650583 11966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:34.650960 11966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:34.656239 11966 server_base.cc:1034] running on GCE node
W20260928 13:03:34.656167 11974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.656201 11976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.656160 11973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:34.657852 11966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:34.658098 11966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:34.659265 11966 hybrid_clock.cc:648] HybridClock initialized: now 1790600614659236 us; error 36 us; skew 500 ppm
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:34.661767 11966 init.cc:377] Logged in from keytab as oryx/127.3.6.2@KRBTEST.COM (short username oryx)
I20260928 13:03:34.662235 11966 webserver.cc:460] Webserver started at http://127.3.6.2:37387/ using document root <none> and password file <none>
I20260928 13:03:34.662487 11966 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.662573 11966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.663975 11966 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.664507 11983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.664671 11966 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:34.664784 11966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "91c1161f42474411b34ab42c35231ce5"
format_stamp: "Formatted at 2026-09-28 13:03:33 on dist-test-slave-ddvw"
server_key: "7ac76ec643ff02a6d1355f7bcca303de"
server_key_iv: "f20073509f0c68fae008e103ad103c1a"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.665118 11966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.698040 11966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.700574 11966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.700737 11966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.700980 11966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:34.701295 11966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:34.701347 11966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.701392 11966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:34.701427 11966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.707479 11966 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:35147
I20260928 13:03:34.707538 12096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:35147 every 8 connection(s)
I20260928 13:03:34.707932 11966 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:34.709283  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 11966
I20260928 13:03:34.709592  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:42865
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:36487
--webserver_port=40955
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43161
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 13:03:34.715832 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.708779 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:46987 (local address 127.3.6.62:36487)
0928 13:03:34.708869 (+    90us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.708871 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.709053 (+   182us) server_negotiation.cc:407] Connection header received
0928 13:03:34.709613 (+   560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.709614 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.709630 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.709677 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.710650 (+   973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.711227 (+   577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.712352 (+  1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.712557 (+   205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.712633 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.715768 (+  3135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:46987: BlockingRecv error: recv got EOF from 127.3.6.2:46987 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260928 13:03:34.715888 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.708767 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:46987)
0928 13:03:34.708924 (+   157us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.708966 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.709504 (+   538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.709758 (+   254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.709763 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.710340 (+   577us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.710545 (+   205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.710549 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.711321 (+   772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.711322 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.712257 (+   935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.712259 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.712629 (+   370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.712641 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.712783 (+   142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.713315 (+   532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.713323 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.715689 (+  2366us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
W20260928 13:03:34.716091 12097 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36487 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.6.62:36487: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.720549 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.716306 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:60309)
0928 13:03:34.716354 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.716365 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.716419 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.716535 (+   116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.716536 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.716657 (+   121us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.716700 (+    43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.716701 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.717345 (+   644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.717346 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.717843 (+   497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.717845 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.718208 (+   363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.718210 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.718284 (+    74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.718709 (+   425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.718714 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.720471 (+  1757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 13:03:34.720600 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.716372 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:60309 (local address 127.3.6.62:36487)
0928 13:03:34.716433 (+    61us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.716435 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.716443 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:34.716467 (+    24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.716468 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.716477 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.716531 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.716821 (+   290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.717260 (+   439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.717938 (+   678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.718125 (+   187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.718210 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.720536 (+  2326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:60309: BlockingRecv error: recv got EOF from 127.3.6.2:60309 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.725248 12099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.720878 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:55221)
0928 13:03:34.720986 (+   108us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.720997 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.721052 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.721184 (+   132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.721185 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.721323 (+   138us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.721356 (+    33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.721357 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.721923 (+   566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.721924 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.722752 (+   828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.722754 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.723116 (+   362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.723119 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.723173 (+    54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.723524 (+   351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.723529 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.725158 (+  1629us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260928 13:03:34.725306 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.720940 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55221 (local address 127.3.6.62:36487)
0928 13:03:34.720988 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.720990 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.721047 (+    57us) server_negotiation.cc:407] Connection header received
0928 13:03:34.721111 (+    64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.721112 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.721119 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.721163 (+    44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.721421 (+   258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.721855 (+   434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.722836 (+   981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.723049 (+   213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.723109 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.725235 (+  2126us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:55221: BlockingRecv error: recv got EOF from 127.3.6.2:55221 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260928 13:03:34.725514 12097 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:03:34.792276 12100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:34.792481 12100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:34.792505 12100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:34.793670 12100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:34.793710 12100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:34.793737 12100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:34.795188 12100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43161
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/krb5kdc/oryx_127.3.6.3.keytab
--principal=oryx/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:42865
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=40955
--tserver_master_addrs=127.3.6.62:36487
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:34.795418 12100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:34.795640 12100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:03:34.800748 12100 server_base.cc:1034] running on GCE node
W20260928 13:03:34.800738 12105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.800740 12106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:34.800889 12108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:34.801141 12100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:34.801405 12100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:34.802580 12100 hybrid_clock.cc:648] HybridClock initialized: now 1790600614802561 us; error 42 us; skew 500 ppm
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600614, etypes {rep=17 tkt=17 ses=17}, oryx/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:34.805120 12100 init.cc:377] Logged in from keytab as oryx/127.3.6.3@KRBTEST.COM (short username oryx)
I20260928 13:03:34.805577 12100 webserver.cc:460] Webserver started at http://127.3.6.3:40955/ using document root <none> and password file <none>
I20260928 13:03:34.805804 12100 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:34.805888 12100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:34.807297 12100 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:34.807904 12115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.808058 12100 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:34.808156 12100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "c7732e3651614ceaa3f08647fb9363d0"
format_stamp: "Formatted at 2026-09-28 13:03:34 on dist-test-slave-ddvw"
server_key: "3596c47ae1a15d94079d0f11048ff5ea"
server_key_iv: "ce3658be7f47628146bf6701ec84a4d1"
server_key_version: "encryptionkey@0"
I20260928 13:03:34.808527 12100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:34.829849 12100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:34.831998 12100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:34.832170 12100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:34.832543 12100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:34.832913 12100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:34.832958 12100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.833007 12100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:34.833039 12100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:34.839298 12100 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:42865
I20260928 13:03:34.839385 12228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:42865 every 8 connection(s)
I20260928 13:03:34.839676 12100 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:34.844585  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12100
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 13:03:34.847533 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.840415 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:59221 (local address 127.3.6.62:36487)
0928 13:03:34.840461 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.840464 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.840700 (+   236us) server_negotiation.cc:407] Connection header received
0928 13:03:34.841205 (+   505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.841206 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.841216 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.841282 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.842274 (+   992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.842748 (+   474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.843839 (+  1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.844049 (+   210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.844110 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.847472 (+  3362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:59221: BlockingRecv error: recv got EOF from 127.3.6.3:59221 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 13:03:34.847620 12231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.840388 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:59221)
0928 13:03:34.840558 (+   170us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.840605 (+    47us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.841116 (+   511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.841355 (+   239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.841359 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.841977 (+   618us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.842184 (+   207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.842189 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.842836 (+   647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.842837 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.843753 (+   916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.843756 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.844118 (+   362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.844128 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.844232 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.844873 (+   641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.844884 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.847398 (+  2514us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
W20260928 13:03:34.847851 12229 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36487 (0 consecutive failures): Not authorized: Failed to ping master at 127.3.6.62:36487: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.852413 11968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.845138 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60258 (local address 127.3.6.62:36487)
0928 13:03:34.845202 (+    64us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.845204 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.845296 (+    92us) server_negotiation.cc:407] Connection header received
0928 13:03:34.845337 (+    41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.845338 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.845351 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.845418 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.845993 (+   575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.846506 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.847369 (+   863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.847592 (+   223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.847661 (+    69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.849047 (+  1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:34.849052 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:34.849053 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:34.849066 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:34.850723 (+  1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.851161 (+   438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.851164 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.851164 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.851296 (+   132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:34.851524 (+   228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:34.851525 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:34.851525 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:34.851846 (+   321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:34.852009 (+   163us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:34.852180 (+   171us) server_negotiation.cc:299] Negotiation successful
0928 13:03:34.852268 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:03:34.852909 12231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.848076 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:51755)
0928 13:03:34.848124 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.848135 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.848176 (+    41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.848286 (+   110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.848286 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.848410 (+   124us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.848454 (+    44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.848455 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.849076 (+   621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.849077 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.849714 (+   637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.849716 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.850158 (+   442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.850160 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.850215 (+    55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.850604 (+   389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.850608 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.852842 (+  2234us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:03:34.852994 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.848131 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:51755 (local address 127.3.6.62:36487)
0928 13:03:34.848173 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.848175 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.848184 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:34.848221 (+    37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.848222 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.848230 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.848281 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.848534 (+   253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.849004 (+   470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.849791 (+   787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.850083 (+   292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.850154 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.852934 (+  2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:51755: BlockingRecv error: recv got EOF from 127.3.6.3:51755 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:34 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:34.857299 12231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:34.853431 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:47289)
0928 13:03:34.853470 (+    39us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:34.853482 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:34.853513 (+    31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:34.853639 (+   126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:34.853639 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:34.853760 (+   121us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:34.853787 (+    27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.853788 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.854397 (+   609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.854398 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.854910 (+   512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:34.854911 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.855304 (+   393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.855307 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:34.855359 (+    52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.855707 (+   348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:34.855710 (+     3us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:34.857214 (+  1504us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260928 13:03:34.857339 11965 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:34.853445 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:47289 (local address 127.3.6.62:36487)
0928 13:03:34.853495 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:34.853497 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:34.853518 (+    21us) server_negotiation.cc:407] Connection header received
0928 13:03:34.853573 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:34.853574 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:34.853583 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:34.853635 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:34.853861 (+   226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.854320 (+   459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.854999 (+   679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:34.855223 (+   224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:34.855305 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:34.857279 (+  1974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:47289: BlockingRecv error: recv got EOF from 127.3.6.3:47289 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260928 13:03:34.857496 12229 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:35.583565 12233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:35.578768 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:50343)
0928 13:03:35.578916 (+   148us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:35.578927 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:35.578983 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:35.579137 (+   154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:35.579138 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:35.579294 (+   156us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:35.579344 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.579346 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.580049 (+   703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.580050 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.580654 (+   604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.580656 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.580974 (+   318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.580977 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.581026 (+    49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.581608 (+   582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:35.581613 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:35.583473 (+  1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
W20260928 13:03:35.583760 12234 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:35.578860 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50343 (local address 127.3.6.62:36487)
0928 13:03:35.578989 (+   129us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:35.578991 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:35.579001 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:35.579065 (+    64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:35.579066 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:35.579074 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:35.579132 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:35.579418 (+   286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.579952 (+   534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.580725 (+   773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.580912 (+   187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.580965 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.583661 (+  2696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:50343: BlockingRecv error: recv got EOF from 127.3.6.1:50343 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":51,"threads_started":1}
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:35.730613 12235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:35.725973 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:46349)
0928 13:03:35.726145 (+   172us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:35.726155 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:35.726221 (+    66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:35.726377 (+   156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:35.726378 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:35.726536 (+   158us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:35.726586 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.726587 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.727237 (+   650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.727238 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.727812 (+   574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.727814 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.728175 (+   361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.728178 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.728228 (+    50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.728756 (+   528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:35.728761 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:35.730539 (+  1778us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":96,"threads_started":1}
W20260928 13:03:35.730695 12234 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:35.726065 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:46349 (local address 127.3.6.62:36487)
0928 13:03:35.726120 (+    55us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:35.726122 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:35.726224 (+   102us) server_negotiation.cc:407] Connection header received
0928 13:03:35.726264 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:35.726264 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:35.726274 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:35.726327 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:35.726657 (+   330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.727171 (+   514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.727919 (+   748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.728107 (+   188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.728170 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.730614 (+  2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:46349: BlockingRecv error: recv got EOF from 127.3.6.2:46349 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:35 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:35.862282 12236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:35.857895 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:56135)
0928 13:03:35.858039 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:35.858052 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:35.858114 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:35.858250 (+   136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:35.858251 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:35.858414 (+   163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:35.858460 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.858462 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.859153 (+   691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.859154 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.859688 (+   534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:35.859689 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.860018 (+   329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.860021 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:35.860069 (+    48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.860597 (+   528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:35.860602 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:35.862210 (+  1608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":55,"threads_started":1}
W20260928 13:03:35.862339 12234 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:35.858016 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:56135 (local address 127.3.6.62:36487)
0928 13:03:35.858085 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:35.858087 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:35.858105 (+    18us) server_negotiation.cc:407] Connection header received
0928 13:03:35.858171 (+    66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:35.858171 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:35.858182 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:35.858229 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:35.858531 (+   302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.859079 (+   548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.859761 (+   682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:35.859937 (+   176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:35.860005 (+    68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:35.862292 (+  2287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:56135: BlockingRecv error: recv got EOF from 127.3.6.3:56135 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:36.588946 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:36.584059 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:38031)
0928 13:03:36.584228 (+   169us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:36.584238 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:36.584291 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:36.584438 (+   147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:36.584438 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:36.584610 (+   172us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:36.584659 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.584661 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.585570 (+   909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.585571 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.586098 (+   527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.586100 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.586424 (+   324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.586427 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.586471 (+    44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.587086 (+   615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:36.587092 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:36.588885 (+  1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
W20260928 13:03:36.589118 12238 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:36.584134 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:38031 (local address 127.3.6.62:36487)
0928 13:03:36.584266 (+   132us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:36.584267 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:36.584279 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:36.584343 (+    64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:36.584343 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:36.584354 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:36.584424 (+    70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:36.584745 (+   321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.585503 (+   758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.586171 (+   668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.586365 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.586415 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.589024 (+  2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:38031: BlockingRecv error: recv got EOF from 127.3.6.1:38031 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:36.736485 12239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:36.731159 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:59915)
0928 13:03:36.731376 (+   217us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:36.731388 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:36.731468 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:36.731618 (+   150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:36.731619 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:36.731863 (+   244us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:36.731961 (+    98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.731964 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.732643 (+   679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.732644 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.733331 (+   687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.733334 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.733708 (+   374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.733711 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.733774 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.734344 (+   570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:36.734349 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:36.736377 (+  2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":97,"threads_started":1}
W20260928 13:03:36.736524 12238 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:36.731264 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:59915 (local address 127.3.6.62:36487)
0928 13:03:36.731369 (+   105us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:36.731371 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:36.731442 (+    71us) server_negotiation.cc:407] Connection header received
0928 13:03:36.731524 (+    82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:36.731525 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:36.731538 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:36.731613 (+    75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:36.732036 (+   423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.732547 (+   511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.733421 (+   874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.733623 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.733709 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.736463 (+  2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:59915: BlockingRecv error: recv got EOF from 127.3.6.2:59915 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:36 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:36.867512 12240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:36.862930 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:50495)
0928 13:03:36.863092 (+   162us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:36.863105 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:36.863181 (+    76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:36.863314 (+   133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:36.863314 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:36.863486 (+   172us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:36.863533 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.863535 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.864163 (+   628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.864164 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.864683 (+   519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:36.864685 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.864989 (+   304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.864992 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:36.865070 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.865602 (+   532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:36.865608 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:36.867451 (+  1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
W20260928 13:03:36.867614 12238 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:36.863104 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:50495 (local address 127.3.6.62:36487)
0928 13:03:36.863167 (+    63us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:36.863169 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:36.863179 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:36.863232 (+    53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:36.863233 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:36.863244 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:36.863293 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:36.863599 (+   306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.864094 (+   495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.864754 (+   660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:36.864927 (+   173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:36.864989 (+    62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:36.867545 (+  2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:50495: BlockingRecv error: recv got EOF from 127.3.6.3:50495 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:37.594261 12241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:37.589468 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:38755)
0928 13:03:37.589627 (+   159us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:37.589637 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:37.589697 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:37.589837 (+   140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:37.589838 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:37.590006 (+   168us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:37.590086 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.590089 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.590987 (+   898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.590988 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.591582 (+   594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.591584 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.591988 (+   404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.591991 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.592031 (+    40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.592502 (+   471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:37.592506 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:37.594192 (+  1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
W20260928 13:03:37.594394 12242 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:37.589574 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:38755 (local address 127.3.6.62:36487)
0928 13:03:37.589704 (+   130us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:37.589707 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:37.589718 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:37.589751 (+    33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:37.589752 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:37.589763 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:37.589823 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:37.590182 (+   359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.590905 (+   723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.591668 (+   763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.591909 (+   241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.591975 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.594287 (+  2312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:38755: BlockingRecv error: recv got EOF from 127.3.6.1:38755 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:37.741461 12243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:37.736951 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:46043)
0928 13:03:37.737084 (+   133us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:37.737095 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:37.737151 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:37.737300 (+   149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:37.737301 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:37.737461 (+   160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:37.737510 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.737512 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.738159 (+   647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.738159 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.738713 (+   554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.738715 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.739082 (+   367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.739087 (+     5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.739151 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.739669 (+   518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:37.739675 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:37.741396 (+  1721us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
W20260928 13:03:37.741565 12242 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:37.737040 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:46043 (local address 127.3.6.62:36487)
0928 13:03:37.737109 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:37.737110 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:37.737140 (+    30us) server_negotiation.cc:407] Connection header received
0928 13:03:37.737214 (+    74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:37.737214 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:37.737224 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:37.737281 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:37.737585 (+   304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.738074 (+   489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.738785 (+   711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.738999 (+   214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.739080 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.741498 (+  2418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:46043: BlockingRecv error: recv got EOF from 127.3.6.2:46043 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:37 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:37.872815 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:37.867991 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:54701)
0928 13:03:37.868133 (+   142us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:37.868144 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:37.868223 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:37.868388 (+   165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:37.868389 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:37.868595 (+   206us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:37.868641 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.868643 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.869313 (+   670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.869314 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.869866 (+   552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:37.869868 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.870228 (+   360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.870232 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:37.870291 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.870780 (+   489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:37.870785 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:37.872729 (+  1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
W20260928 13:03:37.873019 12242 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:37.868073 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54701 (local address 127.3.6.62:36487)
0928 13:03:37.868127 (+    54us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:37.868129 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:37.868213 (+    84us) server_negotiation.cc:407] Connection header received
0928 13:03:37.868290 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:37.868291 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:37.868304 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:37.868382 (+    78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:37.868722 (+   340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.869221 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.869950 (+   729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:37.870144 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:37.870229 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:37.872902 (+  2673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:54701: BlockingRecv error: recv got EOF from 127.3.6.3:54701 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:38.599671 12245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:38.594889 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:39575)
0928 13:03:38.595051 (+   162us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:38.595063 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:38.595135 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:38.595261 (+   126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:38.595262 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:38.595440 (+   178us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:38.595489 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.595490 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.596140 (+   650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.596142 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.596683 (+   541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.596685 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.597021 (+   336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.597024 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.597069 (+    45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.597632 (+   563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:38.597636 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:38.599613 (+  1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":87,"threads_started":1}
W20260928 13:03:38.599777 12246 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:38.594901 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:39575 (local address 127.3.6.62:36487)
0928 13:03:38.595088 (+   187us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:38.595089 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:38.595134 (+    45us) server_negotiation.cc:407] Connection header received
0928 13:03:38.595197 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:38.595198 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:38.595207 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:38.595255 (+    48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:38.595551 (+   296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.596049 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.596762 (+   713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.596952 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.597006 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.599703 (+  2697us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:39575: BlockingRecv error: recv got EOF from 127.3.6.1:39575 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":78,"threads_started":1}
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:38.751991 12247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:38.741983 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:51747)
0928 13:03:38.742152 (+   169us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:38.742166 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:38.742257 (+    91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:38.742403 (+   146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:38.742404 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:38.742587 (+   183us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:38.742635 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.742637 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.743399 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.743401 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.743953 (+   552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.743955 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.744336 (+   381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.744340 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.744406 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.749748 (+  5342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:38.749754 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:38.751922 (+  2168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":97,"threads_started":1}
W20260928 13:03:38.752116 12246 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:38.742088 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:51747 (local address 127.3.6.62:36487)
0928 13:03:38.742171 (+    83us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:38.742174 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:38.742245 (+    71us) server_negotiation.cc:407] Connection header received
0928 13:03:38.742329 (+    84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:38.742330 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:38.742340 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:38.742389 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:38.742729 (+   340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.743317 (+   588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.744051 (+   734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.744251 (+   200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.744337 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.752036 (+  7699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:51747: BlockingRecv error: recv got EOF from 127.3.6.2:51747 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:38 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:38.877686 12248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:38.873288 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:47883)
0928 13:03:38.873474 (+   186us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:38.873484 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:38.873543 (+    59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:38.873668 (+   125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:38.873668 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:38.873835 (+   167us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:38.873884 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.873885 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.874526 (+   641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.874526 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.875083 (+   557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:38.875085 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.875398 (+   313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.875400 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:38.875437 (+    37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.875893 (+   456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:38.875898 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:38.877622 (+  1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":114,"threads_started":1}
W20260928 13:03:38.877755 12246 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:38.873355 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:47883 (local address 127.3.6.62:36487)
0928 13:03:38.873453 (+    98us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:38.873456 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:38.873542 (+    86us) server_negotiation.cc:407] Connection header received
0928 13:03:38.873585 (+    43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:38.873586 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:38.873598 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:38.873651 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:38.873972 (+   321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.874456 (+   484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.875152 (+   696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:38.875337 (+   185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:38.875392 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:38.877709 (+  2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:47883: BlockingRecv error: recv got EOF from 127.3.6.3:47883 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:39.605134 12249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:39.600275 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:37617)
0928 13:03:39.600442 (+   167us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:39.600452 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:39.600538 (+    86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:39.600760 (+   222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:39.600762 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:39.600968 (+   206us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:39.601017 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.601019 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.601714 (+   695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.601716 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.602235 (+   519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.602236 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.602618 (+   382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.602622 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.602682 (+    60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.603200 (+   518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:39.603205 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:39.605071 (+  1866us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":105,"threads_started":1}
W20260928 13:03:39.605321 12250 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:39.600437 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:37617 (local address 127.3.6.62:36487)
0928 13:03:39.600598 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:39.600600 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:39.600609 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:39.600640 (+    31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:39.600641 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:39.600654 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:39.600748 (+    94us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:39.601109 (+   361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.601620 (+   511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.602331 (+   711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.602537 (+   206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.602625 (+    88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.605203 (+  2578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:37617: BlockingRecv error: recv got EOF from 127.3.6.1:37617 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:39.757515 12251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:39.752525 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:41835)
0928 13:03:39.752677 (+   152us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:39.752688 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:39.752740 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:39.752868 (+   128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:39.752869 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:39.753032 (+   163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:39.753081 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.753082 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.753727 (+   645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.753727 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.754518 (+   791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.754521 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.754860 (+   339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.754863 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.754912 (+    49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.755508 (+   596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:39.755513 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:39.757424 (+  1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":99,"threads_started":1}
W20260928 13:03:39.757584 12250 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:39.752670 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:41835 (local address 127.3.6.62:36487)
0928 13:03:39.752727 (+    57us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:39.752729 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:39.752739 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:39.752797 (+    58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:39.752798 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:39.752807 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:39.752849 (+    42us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:39.753149 (+   300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.753648 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.754577 (+   929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.754760 (+   183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.754815 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.757536 (+  2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:41835: BlockingRecv error: recv got EOF from 127.3.6.2:41835 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:39 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:39.882855 12252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:39.878220 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:44207)
0928 13:03:39.878394 (+   174us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:39.878406 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:39.878471 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:39.878647 (+   176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:39.878649 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:39.878810 (+   161us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:39.878859 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.878861 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.879528 (+   667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.879529 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.880159 (+   630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:39.880161 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.880485 (+   324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.880487 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:39.880526 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.881042 (+   516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:39.881047 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:39.882797 (+  1750us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":101,"threads_started":1}
W20260928 13:03:39.882926 12250 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:39.878352 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:44207 (local address 127.3.6.62:36487)
0928 13:03:39.878418 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:39.878420 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:39.878467 (+    47us) server_negotiation.cc:407] Connection header received
0928 13:03:39.878535 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:39.878536 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:39.878547 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:39.878592 (+    45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:39.878937 (+   345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.879460 (+   523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.880226 (+   766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:39.880406 (+   180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:39.880484 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:39.882878 (+  2394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:44207: BlockingRecv error: recv got EOF from 127.3.6.3:44207 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:40.610255 12253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:40.605678 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:37443)
0928 13:03:40.605793 (+   115us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:40.605807 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:40.605878 (+    71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:40.606042 (+   164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:40.606043 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:40.606272 (+   229us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:40.606332 (+    60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.606335 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.606975 (+   640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.606977 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.607556 (+   579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.607557 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.607878 (+   321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.607881 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.607922 (+    41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.608361 (+   439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:40.608365 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:40.610158 (+  1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":66,"threads_started":1}
W20260928 13:03:40.610306 12254 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:40.605741 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:37443 (local address 127.3.6.62:36487)
0928 13:03:40.605860 (+   119us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:40.605862 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:40.605878 (+    16us) server_negotiation.cc:407] Connection header received
0928 13:03:40.605944 (+    66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:40.605945 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:40.605957 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:40.606020 (+    63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:40.606409 (+   389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.606908 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.607623 (+   715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.607808 (+   185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.607872 (+    64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.610234 (+  2362us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:37443: BlockingRecv error: recv got EOF from 127.3.6.1:37443 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":65,"threads_started":1}
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:40.762456 12255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:40.758031 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:50037)
0928 13:03:40.758159 (+   128us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:40.758168 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:40.758222 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:40.758337 (+   115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:40.758337 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:40.758494 (+   157us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:40.758540 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.758541 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.759269 (+   728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.759270 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.759790 (+   520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.759792 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.760126 (+   334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.760129 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.760168 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.760619 (+   451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:40.760624 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:40.762398 (+  1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
W20260928 13:03:40.762619 12254 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:40.758097 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:50037 (local address 127.3.6.62:36487)
0928 13:03:40.758156 (+    59us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:40.758158 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:40.758216 (+    58us) server_negotiation.cc:407] Connection header received
0928 13:03:40.758278 (+    62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:40.758278 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:40.758289 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:40.758325 (+    36us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:40.758625 (+   300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.759188 (+   563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.759872 (+   684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.760061 (+   189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.760118 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.762517 (+  2399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:50037: BlockingRecv error: recv got EOF from 127.3.6.2:50037 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:40 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:40.888242 12256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:40.883392 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:37655)
0928 13:03:40.883555 (+   163us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:40.883569 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:40.883669 (+   100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:40.883819 (+   150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:40.883820 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:40.884011 (+   191us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:40.884059 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.884061 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.884736 (+   675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.884738 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.885266 (+   528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:40.885267 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.885638 (+   371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.885641 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:40.885709 (+    68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.886169 (+   460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:40.886173 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:40.888145 (+  1972us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":84,"threads_started":1}
W20260928 13:03:40.888412 12254 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:40.883477 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37655 (local address 127.3.6.62:36487)
0928 13:03:40.883578 (+   101us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:40.883580 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:40.883650 (+    70us) server_negotiation.cc:407] Connection header received
0928 13:03:40.883747 (+    97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:40.883748 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:40.883762 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:40.883815 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:40.884141 (+   326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.884649 (+   508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.885356 (+   707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:40.885553 (+   197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:40.885639 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:40.888266 (+  2627us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:37655: BlockingRecv error: recv got EOF from 127.3.6.3:37655 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:41.616050 12257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:41.610769 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:51611)
0928 13:03:41.610979 (+   210us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:41.610990 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:41.611068 (+    78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:41.611217 (+   149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:41.611217 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:41.611381 (+   164us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:41.611427 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.611429 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.612124 (+   695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.612124 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.612656 (+   532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.612657 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.613031 (+   374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.613034 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.613084 (+    50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.613677 (+   593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:41.613682 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:41.615953 (+  2271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":112,"threads_started":1}
W20260928 13:03:41.616117 12258 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:41.610891 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51611 (local address 127.3.6.62:36487)
0928 13:03:41.611052 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:41.611054 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:41.611066 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:41.611133 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:41.611134 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:41.611144 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:41.611198 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:41.611493 (+   295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.612017 (+   524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.612728 (+   711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.612917 (+   189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.612970 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.616031 (+  3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:51611: BlockingRecv error: recv got EOF from 127.3.6.1:51611 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":71,"threads_started":1}
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:41.768361 12259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:41.763112 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:50613)
0928 13:03:41.763257 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:41.763269 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:41.763341 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:41.763487 (+   146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:41.763487 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:41.763652 (+   165us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:41.763703 (+    51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.763705 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.764431 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.764432 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.764982 (+   550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.764984 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.765315 (+   331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.765319 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.765360 (+    41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.765877 (+   517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:41.765882 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:41.768260 (+  2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":74,"threads_started":1}
W20260928 13:03:41.768501 12258 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:41.763184 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:50613 (local address 127.3.6.62:36487)
0928 13:03:41.763277 (+    93us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:41.763279 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:41.763327 (+    48us) server_negotiation.cc:407] Connection header received
0928 13:03:41.763393 (+    66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:41.763394 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:41.763404 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:41.763468 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:41.763778 (+   310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.764317 (+   539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.765061 (+   744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.765248 (+   187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.765302 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.768406 (+  3104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:50613: BlockingRecv error: recv got EOF from 127.3.6.2:50613 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:41 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:41.893318 12260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:41.888728 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:58605)
0928 13:03:41.888849 (+   121us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:41.888862 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:41.888926 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:41.889072 (+   146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:41.889072 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:41.889227 (+   155us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:41.889276 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.889278 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.889982 (+   704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.889983 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.890528 (+   545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:41.890529 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.890839 (+   310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.890842 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:41.890881 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.891513 (+   632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:41.891518 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:41.893261 (+  1743us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":55,"threads_started":1}
W20260928 13:03:41.893499 12258 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:41.888819 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:58605 (local address 127.3.6.62:36487)
0928 13:03:41.888910 (+    91us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:41.888912 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:41.888924 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:41.888972 (+    48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:41.888973 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:41.888983 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:41.889035 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:41.889415 (+   380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.889905 (+   490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.890601 (+   696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:41.890778 (+   177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:41.890831 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:41.893385 (+  2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:58605: BlockingRecv error: recv got EOF from 127.3.6.3:58605 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:42.621644 12261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:42.616639 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:36413)
0928 13:03:42.616775 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:42.616794 (+    19us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:42.616854 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:42.617067 (+   213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:42.617067 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:42.617233 (+   166us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:42.617279 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.617281 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.617933 (+   652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.617934 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.618584 (+   650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.618586 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.619054 (+   468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.619057 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.619119 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.619614 (+   495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:42.619618 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:42.621582 (+  1964us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":59,"threads_started":1}
W20260928 13:03:42.621819 12262 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:42.616786 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:36413 (local address 127.3.6.62:36487)
0928 13:03:42.616916 (+   130us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:42.616918 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:42.616929 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:03:42.616969 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:42.616969 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:42.616980 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:42.617046 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:42.617353 (+   307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.617863 (+   510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.618670 (+   807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.618955 (+   285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.619056 (+   101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.621717 (+  2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:36413: BlockingRecv error: recv got EOF from 127.3.6.1:36413 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":74,"threads_started":1}
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:42.774144 12263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:42.768888 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:52795)
0928 13:03:42.769131 (+   243us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:42.769146 (+    15us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:42.769236 (+    90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:42.769373 (+   137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:42.769374 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:42.769559 (+   185us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:42.769607 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.769609 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.770421 (+   812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.770423 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.770997 (+   574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.770999 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.771428 (+   429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.771432 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.771483 (+    51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.772037 (+   554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:42.772041 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:42.774050 (+  2009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":96,"threads_started":1}
W20260928 13:03:42.774221 12262 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:42.769025 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:52795 (local address 127.3.6.62:36487)
0928 13:03:42.769222 (+   197us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:42.769224 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:42.769237 (+    13us) server_negotiation.cc:407] Connection header received
0928 13:03:42.769299 (+    62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:42.769299 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:42.769311 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:42.769365 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:42.769673 (+   308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.770322 (+   649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.771139 (+   817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.771335 (+   196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.771395 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.774156 (+  2761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:52795: BlockingRecv error: recv got EOF from 127.3.6.2:52795 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:42 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:42.898531 12264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:42.893792 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:45107)
0928 13:03:42.893969 (+   177us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:42.893981 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:42.894054 (+    73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:42.894189 (+   135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:42.894190 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:42.894364 (+   174us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:42.894419 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.894421 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.895123 (+   702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.895124 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.895691 (+   567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:42.895693 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.896054 (+   361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.896058 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:42.896103 (+    45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.896672 (+   569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:42.896676 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:42.898471 (+  1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":54,"threads_started":1}
W20260928 13:03:42.898679 12262 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:42.893884 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:45107 (local address 127.3.6.62:36487)
0928 13:03:42.893972 (+    88us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:42.893974 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:42.894049 (+    75us) server_negotiation.cc:407] Connection header received
0928 13:03:42.894102 (+    53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:42.894102 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:42.894113 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:42.894163 (+    50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:42.894486 (+   323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.894965 (+   479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.895781 (+   816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:42.895965 (+   184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:42.896038 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:42.898594 (+  2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:45107: BlockingRecv error: recv got EOF from 127.3.6.3:45107 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:43.626760 12265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:43.622173 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:54553)
0928 13:03:43.622333 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:43.622344 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:43.622399 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:43.622536 (+   137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:43.622537 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:43.622697 (+   160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:43.622746 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.622747 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.623478 (+   731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.623479 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.624016 (+   537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.624018 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.624343 (+   325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.624346 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.624384 (+    38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.624871 (+   487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:43.624875 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:43.626699 (+  1824us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":102,"threads_started":1}
W20260928 13:03:43.626876 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:43.622275 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:54553 (local address 127.3.6.62:36487)
0928 13:03:43.622407 (+   132us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:43.622409 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:43.622419 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:43.622445 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:43.622446 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:43.622456 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:43.622517 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:43.622856 (+   339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.623396 (+   540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.624091 (+   695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.624279 (+   188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.624333 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.626795 (+  2462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:54553: BlockingRecv error: recv got EOF from 127.3.6.1:54553 (error 108)
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:43.784371 12267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:43.774609 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:35497)
0928 13:03:43.774791 (+   182us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:43.774803 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:43.774882 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:43.775073 (+   191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:43.775074 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:43.775270 (+   196us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:43.775317 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.775319 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.776035 (+   716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.776036 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.776584 (+   548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.776586 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.776961 (+   375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.776965 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.777024 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.782189 (+  5165us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:43.782195 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:43.784313 (+  2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":91,"threads_started":1}
W20260928 13:03:43.784557 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:43.774700 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:35497 (local address 127.3.6.62:36487)
0928 13:03:43.774775 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:43.774778 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:43.774881 (+   103us) server_negotiation.cc:407] Connection header received
0928 13:03:43.774942 (+    61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:43.774948 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:43.774961 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:43.775062 (+   101us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:43.775398 (+   336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.775896 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.776670 (+   774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.776871 (+   201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.776964 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.784436 (+  7472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:35497: BlockingRecv error: recv got EOF from 127.3.6.2:35497 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:43 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:43.904022 12268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:43.899080 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:43491)
0928 13:03:43.899209 (+   129us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:43.899229 (+    20us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:43.899279 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:43.899478 (+   199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:43.899479 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:43.899660 (+   181us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:43.899709 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.899710 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.900434 (+   724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.900434 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.900963 (+   529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:43.900964 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.901281 (+   317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.901284 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:43.901321 (+    37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.901844 (+   523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:43.901849 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:43.903962 (+  2113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
W20260928 13:03:43.904178 12266 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:43.899185 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:43491 (local address 127.3.6.62:36487)
0928 13:03:43.899262 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:43.899269 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:43.899279 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:43.899382 (+   103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:43.899383 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:43.899398 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:43.899460 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:43.899801 (+   341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.900357 (+   556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.901041 (+   684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:43.901219 (+   178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:43.901273 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:43.904087 (+  2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:43491: BlockingRecv error: recv got EOF from 127.3.6.3:43491 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:44.632386 12269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:44.627349 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:47693)
0928 13:03:44.627593 (+   244us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:44.627605 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:44.627654 (+    49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:44.627842 (+   188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:44.627843 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:44.628074 (+   231us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:44.628121 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.628123 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.628831 (+   708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.628833 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.629406 (+   573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.629408 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.629743 (+   335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.629746 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.629788 (+    42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.630346 (+   558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:44.630351 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:44.632287 (+  1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":180,"threads_started":1}
W20260928 13:03:44.632444 12270 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:44.627501 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47693 (local address 127.3.6.62:36487)
0928 13:03:44.627628 (+   127us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:44.627630 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:44.627649 (+    19us) server_negotiation.cc:407] Connection header received
0928 13:03:44.627710 (+    61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:44.627711 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:44.627721 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:44.627787 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:44.628234 (+   447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.628750 (+   516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.629480 (+   730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.629682 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.629732 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.632371 (+  2639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:47693: BlockingRecv error: recv got EOF from 127.3.6.1:47693 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:44.789644 12271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:44.784973 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:54995)
0928 13:03:44.785136 (+   163us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:44.785147 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:44.785211 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:44.785351 (+   140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:44.785352 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:44.785524 (+   172us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:44.785574 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.785575 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.786192 (+   617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.786193 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.786722 (+   529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.786723 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.787086 (+   363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.787090 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.787138 (+    48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.787586 (+   448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:44.787590 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:44.789549 (+  1959us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
W20260928 13:03:44.789681 12270 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:44.785027 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:54995 (local address 127.3.6.62:36487)
0928 13:03:44.785098 (+    71us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:44.785100 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:44.785211 (+   111us) server_negotiation.cc:407] Connection header received
0928 13:03:44.785260 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:44.785260 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:44.785271 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:44.785330 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:44.785635 (+   305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.786125 (+   490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.786791 (+   666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.786966 (+   175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.787048 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.789624 (+  2576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:54995: BlockingRecv error: recv got EOF from 127.3.6.2:54995 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:44 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:44.909397 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:44.904622 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:53327)
0928 13:03:44.904754 (+   132us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:44.904773 (+    19us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:44.904856 (+    83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:44.904998 (+   142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:44.904999 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:44.905185 (+   186us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:44.905233 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.905235 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.905915 (+   680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.905917 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.906435 (+   518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:44.906437 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.906815 (+   378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.906819 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:44.906882 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.907453 (+   571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:44.907457 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:44.909300 (+  1843us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
W20260928 13:03:44.909443 12270 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:44.904759 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:53327 (local address 127.3.6.62:36487)
0928 13:03:44.904834 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:44.904836 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:44.904846 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:44.904927 (+    81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:44.904928 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:44.904941 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:44.904992 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:44.905318 (+   326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.905820 (+   502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.906521 (+   701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:44.906734 (+   213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:44.906808 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:44.909379 (+  2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:53327: BlockingRecv error: recv got EOF from 127.3.6.3:53327 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:45.637679 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:45.632902 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:35617)
0928 13:03:45.633047 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:45.633066 (+    19us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:45.633118 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:45.633268 (+   150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:45.633269 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:45.633440 (+   171us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:45.633491 (+    51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.633493 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.634212 (+   719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.634213 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.634771 (+   558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.634773 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.635180 (+   407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.635184 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.635230 (+    46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.635699 (+   469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:45.635704 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:45.637617 (+  1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
W20260928 13:03:45.637831 12274 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:45.632986 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:35617 (local address 127.3.6.62:36487)
0928 13:03:45.633135 (+   149us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:45.633137 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:45.633166 (+    29us) server_negotiation.cc:407] Connection header received
0928 13:03:45.633188 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:45.633189 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:45.633199 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:45.633251 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:45.633560 (+   309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.634132 (+   572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.634857 (+   725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.635116 (+   259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.635173 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.637732 (+  2559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:35617: BlockingRecv error: recv got EOF from 127.3.6.1:35617 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:45.794937 12275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:45.790176 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:60443)
0928 13:03:45.790335 (+   159us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:45.790345 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:45.790396 (+    51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:45.790593 (+   197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:45.790594 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:45.790753 (+   159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:45.790802 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.790803 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.791558 (+   755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.791559 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.792311 (+   752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.792314 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.792620 (+   306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.792623 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.792661 (+    38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.793115 (+   454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:45.793119 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:45.794871 (+  1752us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260928 13:03:45.795065 12274 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:45.790298 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:60443 (local address 127.3.6.62:36487)
0928 13:03:45.790367 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:45.790368 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:45.790381 (+    13us) server_negotiation.cc:407] Connection header received
0928 13:03:45.790480 (+    99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:45.790481 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:45.790495 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:45.790570 (+    75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:45.790864 (+   294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.791452 (+   588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.792368 (+   916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.792557 (+   189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.792614 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.794966 (+  2352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:60443: BlockingRecv error: recv got EOF from 127.3.6.2:60443 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:45 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:45.914956 12276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:45.910029 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:54311)
0928 13:03:45.910189 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:45.910209 (+    20us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:45.910271 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:45.910416 (+   145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:45.910417 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:45.910586 (+   169us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:45.910633 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.910634 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.911387 (+   753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.911388 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.911976 (+   588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:45.911978 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.912372 (+   394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.912376 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:45.912441 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.912966 (+   525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:45.912970 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:45.914898 (+  1928us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":110,"threads_started":1}
W20260928 13:03:45.915185 12274 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:45.910085 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54311 (local address 127.3.6.62:36487)
0928 13:03:45.910163 (+    78us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:45.910165 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:45.910269 (+   104us) server_negotiation.cc:407] Connection header received
0928 13:03:45.910324 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:45.910325 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:45.910336 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:45.910390 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:45.910695 (+   305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.911285 (+   590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.912059 (+   774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:45.912275 (+   216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:45.912325 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:45.915118 (+  2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:54311: BlockingRecv error: recv got EOF from 127.3.6.3:54311 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:46.642858 12277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:46.638152 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:48939)
0928 13:03:46.638303 (+   151us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:46.638314 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:46.638409 (+    95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:46.638592 (+   183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:46.638593 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:46.638768 (+   175us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:46.638818 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.638819 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.639540 (+   721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.639540 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.640079 (+   539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.640081 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.640406 (+   325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.640408 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.640447 (+    39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.640896 (+   449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:46.640901 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:46.642769 (+  1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
W20260928 13:03:46.642921 12278 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:46.638229 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:48939 (local address 127.3.6.62:36487)
0928 13:03:46.638320 (+    91us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:46.638322 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:46.638417 (+    95us) server_negotiation.cc:407] Connection header received
0928 13:03:46.638466 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:46.638467 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:46.638479 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:46.638579 (+   100us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:46.638887 (+   308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.639471 (+   584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.640154 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.640343 (+   189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.640392 (+    49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.642868 (+  2476us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:48939: BlockingRecv error: recv got EOF from 127.3.6.1:48939 (error 108)
Metrics: {"server-negotiator.queue_time_us":68,"thread_start_us":41,"threads_started":1}
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:46.800304 12279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:46.795445 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:44655)
0928 13:03:46.795582 (+   137us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:46.795593 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:46.795650 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:46.795794 (+   144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:46.795795 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:46.795978 (+   183us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:46.796027 (+    49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.796028 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.796790 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.796791 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.797340 (+   549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.797342 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.797733 (+   391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.797737 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.797780 (+    43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.798270 (+   490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:46.798274 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:46.800235 (+  1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":77,"threads_started":1}
W20260928 13:03:46.800451 12278 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:46.795518 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:44655 (local address 127.3.6.62:36487)
0928 13:03:46.795595 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:46.795597 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:46.795639 (+    42us) server_negotiation.cc:407] Connection header received
0928 13:03:46.795710 (+    71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:46.795711 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:46.795721 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:46.795777 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:46.796144 (+   367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.796682 (+   538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.797451 (+   769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.797664 (+   213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.797721 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.800330 (+  2609us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:44655: BlockingRecv error: recv got EOF from 127.3.6.2:44655 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:46 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:46.920594 12280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:46.915480 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:40449)
0928 13:03:46.915681 (+   201us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:46.915692 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:46.915789 (+    97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:46.915987 (+   198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:46.915988 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:46.916168 (+   180us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:46.916216 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.916218 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.916900 (+   682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.916901 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.917452 (+   551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:46.917454 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.917827 (+   373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.917830 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:46.917901 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.918432 (+   531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:46.918437 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:46.920521 (+  2084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":97,"threads_started":1}
W20260928 13:03:46.920717 12278 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:46.915590 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:40449 (local address 127.3.6.62:36487)
0928 13:03:46.915659 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:46.915661 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:46.915769 (+   108us) server_negotiation.cc:407] Connection header received
0928 13:03:46.915854 (+    85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:46.915855 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:46.915869 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:46.915968 (+    99us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:46.916296 (+   328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.916806 (+   510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.917553 (+   747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:46.917743 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:46.917827 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:46.920639 (+  2812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:40449: BlockingRecv error: recv got EOF from 127.3.6.3:40449 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:47.648088 12281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:47.643403 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:33177)
0928 13:03:47.643519 (+   116us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:47.643532 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:47.643594 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:47.643764 (+   170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:47.643765 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:47.643928 (+   163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:47.643976 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.643977 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.644639 (+   662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.644641 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.645213 (+   572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.645215 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.645571 (+   356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.645574 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.645617 (+    43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.646177 (+   560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:47.646182 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:47.648028 (+  1846us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":56,"threads_started":1}
W20260928 13:03:47.648217 12282 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:47.643481 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:33177 (local address 127.3.6.62:36487)
0928 13:03:47.643645 (+   164us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:47.643647 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:47.643655 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:03:47.643675 (+    20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:47.643676 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:47.643685 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:47.643745 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:47.644049 (+   304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.644552 (+   503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.645300 (+   748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.645503 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.645558 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.648129 (+  2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:33177: BlockingRecv error: recv got EOF from 127.3.6.1:33177 (error 108)
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":90,"threads_started":1}
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:47.805758 12283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:47.800807 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:58023)
0928 13:03:47.800956 (+   149us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:47.800970 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:47.801035 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:47.801192 (+   157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:47.801193 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:47.801377 (+   184us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:47.801422 (+    45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.801424 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.802133 (+   709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.802135 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.802677 (+   542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.802679 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.803100 (+   421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.803104 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.803166 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.803776 (+   610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:47.803782 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:47.805699 (+  1917us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":89,"threads_started":1}
W20260928 13:03:47.805912 12282 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:47.800948 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:58023 (local address 127.3.6.62:36487)
0928 13:03:47.801013 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:47.801015 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:47.801025 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:47.801097 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:47.801098 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:47.801111 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:47.801186 (+    75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:47.801539 (+   353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.802042 (+   503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.802766 (+   724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.802969 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.803088 (+   119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.805820 (+  2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:58023: BlockingRecv error: recv got EOF from 127.3.6.2:58023 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:47 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:47.926085 12284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:47.921182 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:37505)
0928 13:03:47.921371 (+   189us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:47.921382 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:47.921462 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:47.921595 (+   133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:47.921596 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:47.921765 (+   169us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:47.921812 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.921813 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.922450 (+   637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.922452 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.923216 (+   764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:47.923219 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.923640 (+   421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.923644 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:47.923704 (+    60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.924165 (+   461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:47.924170 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:47.925979 (+  1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":100,"threads_started":1}
W20260928 13:03:47.926119 12282 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:47.921320 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37505 (local address 127.3.6.62:36487)
0928 13:03:47.921398 (+    78us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:47.921399 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:47.921457 (+    58us) server_negotiation.cc:407] Connection header received
0928 13:03:47.921509 (+    52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:47.921509 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:47.921522 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:47.921579 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:47.921871 (+   292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.922369 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.923318 (+   949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:47.923541 (+   223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:47.923630 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:47.926054 (+  2424us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:37505: BlockingRecv error: recv got EOF from 127.3.6.3:37505 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:48.653366 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:48.648705 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:52983)
0928 13:03:48.648857 (+   152us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:48.648867 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:48.648919 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:48.649071 (+   152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:48.649072 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:48.649225 (+   153us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:48.649272 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.649274 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.649915 (+   641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.649916 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.650428 (+   512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.650429 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.650757 (+   328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.650760 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.650796 (+    36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.651290 (+   494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:48.651294 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:48.653275 (+  1981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
W20260928 13:03:48.653421 12286 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:48.648778 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:52983 (local address 127.3.6.62:36487)
0928 13:03:48.648925 (+   147us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:48.648927 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:48.648939 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:03:48.648971 (+    32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:48.648972 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:48.648983 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:48.649052 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:48.649343 (+   291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.649849 (+   506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.650503 (+   654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.650693 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.650748 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.653331 (+  2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:52983: BlockingRecv error: recv got EOF from 127.3.6.1:52983 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":88,"threads_started":1}
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:48.815567 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:48.806201 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:39817)
0928 13:03:48.806367 (+   166us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:48.806379 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:48.806446 (+    67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:48.806613 (+   167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:48.806613 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:48.806793 (+   180us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:48.806838 (+    45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.806841 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.807567 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.807568 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.808106 (+   538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.808108 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.808475 (+   367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.808478 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.808537 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.813393 (+  4856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:48.813398 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:48.815487 (+  2089us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
W20260928 13:03:48.815703 12286 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:48.806290 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:39817 (local address 127.3.6.62:36487)
0928 13:03:48.806363 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:48.806365 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:48.806427 (+    62us) server_negotiation.cc:407] Connection header received
0928 13:03:48.806501 (+    74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:48.806502 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:48.806515 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:48.806604 (+    89us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:48.806920 (+   316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.807476 (+   556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.808190 (+   714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.808392 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.808475 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.815611 (+  7136us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:39817: BlockingRecv error: recv got EOF from 127.3.6.2:39817 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:48 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.3@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:48.931381 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:48.926631 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.3:55071)
0928 13:03:48.926810 (+   179us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:48.926825 (+    15us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:48.926902 (+    77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:48.927122 (+   220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:48.927123 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:48.927282 (+   159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:48.927330 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.927332 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.927998 (+   666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.927999 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.928520 (+   521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:48.928522 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.928866 (+   344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.928869 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:48.928910 (+    41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.929392 (+   482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:48.929397 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:48.931319 (+  1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":75,"threads_started":1}
W20260928 13:03:48.931510 12286 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:48.926771 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:55071 (local address 127.3.6.62:36487)
0928 13:03:48.926836 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:48.926837 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:48.926967 (+   130us) server_negotiation.cc:407] Connection header received
0928 13:03:48.926996 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:48.926996 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:48.927035 (+    39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:48.927094 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:48.927401 (+   307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.927883 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.928604 (+   721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:48.928796 (+   192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:48.928854 (+    58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:48.931426 (+  2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.3:55071: BlockingRecv error: recv got EOF from 127.3.6.3:55071 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 28 13:03:49 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:49 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.1@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:49.658583 12289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:49.653862 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.1:45101)
0928 13:03:49.653987 (+   125us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:49.653998 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:49.654052 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:49.654192 (+   140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:49.654192 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:49.654351 (+   159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:49.654399 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:49.654401 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.655197 (+   796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.655199 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:49.655758 (+   559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:49.655761 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.656156 (+   395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.656158 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:49.656201 (+    43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:49.656654 (+   453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:49.656659 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:49.658470 (+  1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":74,"threads_started":1}
W20260928 13:03:49.658622 12290 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:49.653955 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:45101 (local address 127.3.6.62:36487)
0928 13:03:49.654067 (+   112us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:49.654069 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:49.654079 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:49.654107 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:49.654108 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:49.654117 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:49.654174 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:49.654517 (+   343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.655095 (+   578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.655840 (+   745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.656086 (+   246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.656145 (+    59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:49.658550 (+  2405us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.1:45101: BlockingRecv error: recv got EOF from 127.3.6.1:45101 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":67,"threads_started":1}
Sep 28 13:03:49 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 13:03:49 dist-test-slave-ddvw krb5kdc[11231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0,  oryx/127.3.6.2@KRBTEST.COM for oryx/127.3.6.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 13:03:49.820833 12291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:49.816122 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36487 (local address 127.3.6.2:49917)
0928 13:03:49.816293 (+   171us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:49.816305 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:49.816392 (+    87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:49.816538 (+   146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:49.816539 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:49.816716 (+   177us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:49.816763 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:49.816766 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.817443 (+   677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.817444 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:49.818011 (+   567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:49.818013 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.818403 (+   390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.818407 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:49.818474 (+    67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:49.818996 (+   522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:49.819000 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:49.820725 (+  1725us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.3.6.62:36487: Server oryx/127.3.6.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":107,"threads_started":1}
W20260928 13:03:49.820870 12290 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:49.816215 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:49917 (local address 127.3.6.62:36487)
0928 13:03:49.816286 (+    71us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:49.816288 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:49.816380 (+    92us) server_negotiation.cc:407] Connection header received
0928 13:03:49.816469 (+    89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:49.816470 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:49.816481 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:49.816535 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:49.816863 (+   328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.817361 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.818117 (+   756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:49.818320 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:49.818403 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:49.820806 (+  2403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.3.6.2:49917: BlockingRecv error: recv got EOF from 127.3.6.2:49917 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 13:03:49.846066  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11814
I20260928 13:03:49.850605  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11966
I20260928 13:03:49.854704  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12100
I20260928 13:03:49.858798  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 11744
2026-09-28T13:03:49Z chronyd exiting
[       OK ] SecurityITest.TestMismatchingPrincipals (17488 ms)
[ RUN      ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-28T13:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:49Z Disabled control of system clock
I20260928 13:03:49.886026  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:46453
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:46453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260928 13:03:49.964829 12295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:49.965032 12295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:49.965054 12295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:49.966171 12295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:49.966207 12295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:49.966219 12295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:49.966233 12295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:49.966244 12295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:49.967597 12295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:46453
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:46453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:49.967787 12295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:49.968020 12295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:49.972819 12301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:49.972798 12303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:49.972957 12295 server_base.cc:1034] running on GCE node
W20260928 13:03:49.972800 12300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:49.973323 12295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:49.973659 12295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:49.974813 12295 hybrid_clock.cc:648] HybridClock initialized: now 1790600629974801 us; error 29 us; skew 500 ppm
I20260928 13:03:49.976096 12295 webserver.cc:460] Webserver started at http://127.3.6.62:40033/ using document root <none> and password file <none>
I20260928 13:03:49.976339 12295 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:49.976409 12295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:49.976543 12295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:49.977561 12295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "b625f3ada0814c2a95d8d26d2ff63c66"
format_stamp: "Formatted at 2026-09-28 13:03:49 on dist-test-slave-ddvw"
server_key: "82f122d129aa96c04c0bca6143bd3671"
server_key_iv: "75584df35c7a6d97b669eeb3d54166a3"
server_key_version: "encryptionkey@0"
I20260928 13:03:49.977929 12295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "b625f3ada0814c2a95d8d26d2ff63c66"
format_stamp: "Formatted at 2026-09-28 13:03:49 on dist-test-slave-ddvw"
server_key: "82f122d129aa96c04c0bca6143bd3671"
server_key_iv: "75584df35c7a6d97b669eeb3d54166a3"
server_key_version: "encryptionkey@0"
I20260928 13:03:49.979302 12295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:49.980180 12309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:49.980376 12295 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:49.980471 12295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "b625f3ada0814c2a95d8d26d2ff63c66"
format_stamp: "Formatted at 2026-09-28 13:03:49 on dist-test-slave-ddvw"
server_key: "82f122d129aa96c04c0bca6143bd3671"
server_key_iv: "75584df35c7a6d97b669eeb3d54166a3"
server_key_version: "encryptionkey@0"
I20260928 13:03:49.980557 12295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:49.988739 12295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:49.989003 12295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:49.989151 12295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:49.993007 12295 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:46453
I20260928 13:03:49.993041 12361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:46453 every 8 connection(s)
I20260928 13:03:49.993382 12295 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:49.994025 12362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:49.996658 12362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66: Bootstrap starting.
I20260928 13:03:49.997255 12362 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:49.997555 12362 log.cc:824] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:49.998232 12362 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66: No bootstrap required, opened a new log
I20260928 13:03:49.999902  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12295
I20260928 13:03:50.000001  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:50.000190  3096 external_mini_cluster.cc:1428] Setting key a8db08fb0380bcea6621e04b69971c5b
I20260928 13:03:49.999974 12362 raft_consensus.cc:348] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } }
I20260928 13:03:50.000444 12362 raft_consensus.cc:374] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:50.000507 12362 raft_consensus.cc:729] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b625f3ada0814c2a95d8d26d2ff63c66, State: Initialized, Role: FOLLOWER
I20260928 13:03:50.000700 12362 consensus_queue.cc:260] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } }
I20260928 13:03:50.000815 12362 raft_consensus.cc:388] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:50.000883 12362 raft_consensus.cc:482] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:50.000989 12362 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:50.001729 12362 raft_consensus.cc:504] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } }
I20260928 13:03:50.001814 12362 leader_election.cc:302] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b625f3ada0814c2a95d8d26d2ff63c66; no voters: 
I20260928 13:03:50.002063 12362 leader_election.cc:288] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:50.002094 12367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:50.002197 12367 raft_consensus.cc:686] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [term 1 LEADER]: Becoming Leader. State: Replica: b625f3ada0814c2a95d8d26d2ff63c66, State: Running, Role: LEADER
I20260928 13:03:50.002275 12367 consensus_queue.cc:237] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } }
I20260928 13:03:50.002336 12362 sys_catalog.cc:564] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:50.002599 12367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } } }
I20260928 13:03:50.002753 12367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:50.002933 12367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b625f3ada0814c2a95d8d26d2ff63c66. Latest consensus state: current_term: 1 leader_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625f3ada0814c2a95d8d26d2ff63c66" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 46453 } } }
I20260928 13:03:50.003084 12367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:50.003484 12374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:50.004047 12374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:50.005769 12374 catalog_manager.cc:1347] Generated new cluster ID: 930591fde7fd4c51bb11072e25615d08
I20260928 13:03:50.005823 12374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:50.006476 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.000726 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38738 (local address 127.3.6.62:46453)
0928 13:03:50.000945 (+   219us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.000953 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.000983 (+    30us) server_negotiation.cc:407] Connection header received
0928 13:03:50.001130 (+   147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.001142 (+    12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.001201 (+    59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.001310 (+   109us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.001555 (+   245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.003272 (+  1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.004370 (+  1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.004919 (+   549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.005064 (+   145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.005752 (+   688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.005755 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.005756 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.005982 (+   226us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.006022 (+    40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.006035 (+    13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.006103 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.006206 (+   103us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.006283 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":87,"threads_started":1}
I20260928 13:03:50.010840 12374 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:50.011549 12374 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:50.017699 12374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b625f3ada0814c2a95d8d26d2ff63c66: Generated new TSK 0
I20260928 13:03:50.017906 12374 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:50.019325  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--builtin_ntp_servers=127.3.6.20:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260928 13:03:50.104588 12386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.104794 12386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.104816 12386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.105998 12386 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.106038 12386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.106062 12386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:50.107473 12386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12386
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.107704 12386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.108042 12386 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.113955 12392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.114055 12391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.113955 12394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.114378 12386 server_base.cc:1034] running on GCE node
I20260928 13:03:50.114596 12386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.114892 12386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.116086 12386 hybrid_clock.cc:648] HybridClock initialized: now 1790600630116071 us; error 36 us; skew 500 ppm
I20260928 13:03:50.117626 12386 webserver.cc:460] Webserver started at http://127.3.6.1:44293/ using document root <none> and password file <none>
I20260928 13:03:50.117904 12386 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.117972 12386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.118110 12386 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.119570 12386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "f3ef2cfd9d4343c1a02f10bcc88af7e6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "45e04a0eb2f92474a85034fa4ffebde0"
server_key_iv: "812c545b360e394f0ba6909c8ce66f9c"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.119999 12386 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "f3ef2cfd9d4343c1a02f10bcc88af7e6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "45e04a0eb2f92474a85034fa4ffebde0"
server_key_iv: "812c545b360e394f0ba6909c8ce66f9c"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.121626 12386 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:50.122465 12400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.122685 12386 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:50.122766 12386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "f3ef2cfd9d4343c1a02f10bcc88af7e6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "45e04a0eb2f92474a85034fa4ffebde0"
server_key_iv: "812c545b360e394f0ba6909c8ce66f9c"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.122824 12386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.143333 12386 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.143693 12386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.143850 12386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.144138 12386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.144466 12386 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.144500 12386 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.144522 12386 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.144537 12386 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.150323 12386 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:38369
I20260928 13:03:50.150383 12513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:38369 every 8 connection(s)
I20260928 13:03:50.150705 12386 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:50.154749  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12386
I20260928 13:03:50.154841  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:50.155071  3096 external_mini_cluster.cc:1428] Setting key 6fca602498d30e5e827a1ed065d497ca
I20260928 13:03:50.156126 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.151536 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51651 (local address 127.3.6.62:46453)
0928 13:03:50.151640 (+   104us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.151643 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.151846 (+   203us) server_negotiation.cc:407] Connection header received
0928 13:03:50.152311 (+   465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.152312 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.152322 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.152373 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.153026 (+   653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.153501 (+   475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.154462 (+   961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.154656 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.154710 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.155821 (+  1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.155823 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.155823 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.155828 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.155847 (+    19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.155851 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.155904 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.155972 (+    68us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.156009 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260928 13:03:50.156147  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--builtin_ntp_servers=127.3.6.20:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260928 13:03:50.156234 12516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.151501 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:46453 (local address 127.3.6.1:51651)
0928 13:03:50.151723 (+   222us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.151757 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.152227 (+   470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.152435 (+   208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.152439 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.152447 (+     8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.152951 (+   504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.152955 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.153581 (+   626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.153581 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.154377 (+   796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.154379 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.154742 (+   363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.154755 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.154927 (+   172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.155644 (+   717us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.155644 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.155673 (+    29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.155716 (+    43us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.155907 (+   191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.155910 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.155912 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.155963 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.156045 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":120,"threads_started":1}
I20260928 13:03:50.157547 12514 heartbeater.cc:347] Connected to a master server at 127.3.6.62:46453
I20260928 13:03:50.157635 12514 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.157845 12514 heartbeater.cc:511] Master 127.3.6.62:46453 requested a full tablet report, sending...
I20260928 13:03:50.158370 12326 ts_manager.cc:194] Registered new tserver with Master: f3ef2cfd9d4343c1a02f10bcc88af7e6 (127.3.6.1:38369)
I20260928 13:03:50.159366 12326 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.1:51651
W20260928 13:03:50.237775 12517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.237985 12517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.238008 12517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.239188 12517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.239228 12517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.239252 12517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:50.240736 12517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.240924 12517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.241169 12517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.246105 12523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.246147 12525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.246105 12522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.246279 12517 server_base.cc:1034] running on GCE node
I20260928 13:03:50.246551 12517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.246820 12517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.247979 12517 hybrid_clock.cc:648] HybridClock initialized: now 1790600630247992 us; error 60 us; skew 500 ppm
I20260928 13:03:50.249212 12517 webserver.cc:460] Webserver started at http://127.3.6.2:33479/ using document root <none> and password file <none>
I20260928 13:03:50.249464 12517 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.249532 12517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.249701 12517 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.250782 12517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "e52b3c7adf4a4739a59e09689b60c7a0"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "d4345489dfa85804e28453a6133614ef"
server_key_iv: "31706d7db5f288ee9ffe8f7e06f55db6"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.251194 12517 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "e52b3c7adf4a4739a59e09689b60c7a0"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "d4345489dfa85804e28453a6133614ef"
server_key_iv: "31706d7db5f288ee9ffe8f7e06f55db6"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.252506 12517 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:50.253244 12531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.253424 12517 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:03:50.253520 12517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "e52b3c7adf4a4739a59e09689b60c7a0"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "d4345489dfa85804e28453a6133614ef"
server_key_iv: "31706d7db5f288ee9ffe8f7e06f55db6"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.253615 12517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.264880 12517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.265213 12517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.265362 12517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.265599 12517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.265914 12517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.265967 12517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.266011 12517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.266049 12517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.272082 12517 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44645
I20260928 13:03:50.272127 12644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44645 every 8 connection(s)
I20260928 13:03:50.272468 12517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:50.277557 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.273269 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:53007 (local address 127.3.6.62:46453)
0928 13:03:50.273311 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.273314 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.273564 (+   250us) server_negotiation.cc:407] Connection header received
0928 13:03:50.274024 (+   460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.274025 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.274036 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.274088 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.274722 (+   634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.275293 (+   571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.276282 (+   989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.276485 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.276551 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.277324 (+   773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.277325 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.277325 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.277329 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.277343 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.277347 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.277403 (+    56us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.277478 (+    75us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.277500 (+    22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:03:50.277767 12647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.273230 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:46453 (local address 127.3.6.2:53007)
0928 13:03:50.273417 (+   187us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.273457 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.273936 (+   479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.274150 (+   214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.274154 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.274163 (+     9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.274639 (+   476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.274643 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.275376 (+   733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.275377 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.276182 (+   805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.276184 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.276556 (+   372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.276565 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.276674 (+   109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.277192 (+   518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.277193 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.277220 (+    27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.277242 (+    22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.277406 (+   164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.277409 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.277412 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.277463 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.277540 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260928 13:03:50.278337 12645 heartbeater.cc:347] Connected to a master server at 127.3.6.62:46453
I20260928 13:03:50.278426 12645 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.278626 12645 heartbeater.cc:511] Master 127.3.6.62:46453 requested a full tablet report, sending...
I20260928 13:03:50.279080 12326 ts_manager.cc:194] Registered new tserver with Master: e52b3c7adf4a4739a59e09689b60c7a0 (127.3.6.2:44645)
I20260928 13:03:50.279525 12326 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.2:53007
I20260928 13:03:50.281368  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12517
I20260928 13:03:50.281443  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:50.281594  3096 external_mini_cluster.cc:1428] Setting key fe1e7ea3f582722ec8ae798c391c3ec5
I20260928 13:03:50.282400  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--builtin_ntp_servers=127.3.6.20:42711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260928 13:03:50.364308 12648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.364516 12648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.364535 12648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.365621 12648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.365656 12648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.365680 12648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:50.367056 12648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:42711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:46453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.367235 12648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.367471 12648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.372469 12656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.372474 12653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.372491 12654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.372687 12648 server_base.cc:1034] running on GCE node
I20260928 13:03:50.372875 12648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.373111 12648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.374269 12648 hybrid_clock.cc:648] HybridClock initialized: now 1790600630374265 us; error 39 us; skew 500 ppm
I20260928 13:03:50.375612 12648 webserver.cc:460] Webserver started at http://127.3.6.3:45793/ using document root <none> and password file <none>
I20260928 13:03:50.375857 12648 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.375905 12648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.376091 12648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.377260 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "3baba987d42c42bfafdae4fce499b936"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "1e4fbf3f179eb60255edc0eae29b5757"
server_key_iv: "20be3052192d9c2db2b0be257590b032"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.377637 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "3baba987d42c42bfafdae4fce499b936"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "1e4fbf3f179eb60255edc0eae29b5757"
server_key_iv: "20be3052192d9c2db2b0be257590b032"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.378907 12648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:50.379738 12662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.379906 12648 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:50.380048 12648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "3baba987d42c42bfafdae4fce499b936"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "1e4fbf3f179eb60255edc0eae29b5757"
server_key_iv: "20be3052192d9c2db2b0be257590b032"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.380133 12648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.401918 12648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.402292 12648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.402477 12648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.402734 12648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.403244 12648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.403298 12648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.403333 12648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.403363 12648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.409205 12648 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:41503
I20260928 13:03:50.409245 12775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:41503 every 8 connection(s)
I20260928 13:03:50.409595 12648 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:50.414552 12366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.410290 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:41901 (local address 127.3.6.62:46453)
0928 13:03:50.410331 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.410333 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.410598 (+   265us) server_negotiation.cc:407] Connection header received
0928 13:03:50.411172 (+   574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.411173 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.411183 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.411226 (+    43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.411849 (+   623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.412350 (+   501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.413287 (+   937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.413466 (+   179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.413514 (+    48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.414358 (+   844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.414358 (+     0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.414359 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.414362 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.414372 (+    10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.414376 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.414413 (+    37us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.414475 (+    62us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.414495 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:03:50.414788 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.410281 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:46453 (local address 127.3.6.3:41901)
0928 13:03:50.410439 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.410507 (+    68us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.411057 (+   550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.411281 (+   224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.411284 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.411293 (+     9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.411781 (+   488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.411785 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.412433 (+   648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.412434 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.413214 (+   780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:50.413216 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:50.413525 (+   309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:50.413533 (+     8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:50.413643 (+   110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:50.414241 (+   598us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.414241 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.414270 (+    29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.414292 (+    22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.414413 (+   121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.414416 (+     3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.414418 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.414471 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.414546 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":67,"threads_started":1}
I20260928 13:03:50.415264 12776 heartbeater.cc:347] Connected to a master server at 127.3.6.62:46453
I20260928 13:03:50.415361 12776 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.415503 12776 heartbeater.cc:511] Master 127.3.6.62:46453 requested a full tablet report, sending...
I20260928 13:03:50.415879 12326 ts_manager.cc:194] Registered new tserver with Master: 3baba987d42c42bfafdae4fce499b936 (127.3.6.3:41503)
I20260928 13:03:50.416217 12326 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.3:41901
I20260928 13:03:50.417378  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12648
I20260928 13:03:50.417464  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:50.417698  3096 external_mini_cluster.cc:1428] Setting key 346595153db49c287fc7eac0c8b17d7d
I20260928 13:03:50.418560  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 13:03:50.420516 12366 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:50.419951 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38742 (local address 127.3.6.62:46453)
0928 13:03:50.420041 (+    90us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.420043 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.420130 (+    87us) server_negotiation.cc:407] Connection header received
0928 13:03:50.420207 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.420208 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.420221 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.420290 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.420423 (+   133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38742: BlockingRecv error: recv got EOF from 127.0.0.1:38742 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260928 13:03:50.420545  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12386
I20260928 13:03:50.425791  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12517
I20260928 13:03:50.429986  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12648
I20260928 13:03:50.433959  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12295
2026-09-28T13:03:50Z chronyd exiting
[       OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (573 ms)
[ RUN      ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-28T13:03:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:50Z Disabled control of system clock
I20260928 13:03:50.459491  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34365
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:34365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 13:03:50.542030 12787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.542268 12787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.542289 12787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.543457 12787 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:50.543495 12787 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.543509 12787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.543521 12787 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:50.543533 12787 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:50.544837 12787 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:34365
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12787
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.545032 12787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.545292 12787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.550549 12792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.550534 12795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.550581 12793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.550920 12787 server_base.cc:1034] running on GCE node
I20260928 13:03:50.551278 12787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.551594 12787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.552766 12787 hybrid_clock.cc:648] HybridClock initialized: now 1790600630552749 us; error 33 us; skew 500 ppm
I20260928 13:03:50.554142 12787 webserver.cc:460] Webserver started at http://127.3.6.62:39195/ using document root <none> and password file <none>
I20260928 13:03:50.554407 12787 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.554504 12787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.554656 12787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.555852 12787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "270072defc4a43d0a3c5ccab52c5ccd6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "eb620d8026ca2f51d5257d7ad67f2e76"
server_key_iv: "8ce9647af9720f689a81cf4883baf85a"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.556236 12787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "270072defc4a43d0a3c5ccab52c5ccd6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "eb620d8026ca2f51d5257d7ad67f2e76"
server_key_iv: "8ce9647af9720f689a81cf4883baf85a"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.557530 12787 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:03:50.558332 12801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.558504 12787 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.558609 12787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "270072defc4a43d0a3c5ccab52c5ccd6"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "eb620d8026ca2f51d5257d7ad67f2e76"
server_key_iv: "8ce9647af9720f689a81cf4883baf85a"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.558683 12787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.561995 12787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.562266 12787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.562412 12787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.566272 12787 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:34365
I20260928 13:03:50.566301 12853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:34365 every 8 connection(s)
I20260928 13:03:50.566632 12787 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:50.567325 12854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:50.570052 12854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6: Bootstrap starting.
I20260928 13:03:50.570639 12854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:50.570933 12854 log.cc:824] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:50.571641 12854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6: No bootstrap required, opened a new log
I20260928 13:03:50.573180 12854 raft_consensus.cc:348] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } }
I20260928 13:03:50.573338 12854 raft_consensus.cc:374] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:50.573362 12854 raft_consensus.cc:729] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 270072defc4a43d0a3c5ccab52c5ccd6, State: Initialized, Role: FOLLOWER
I20260928 13:03:50.573515  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12787
I20260928 13:03:50.573521 12854 consensus_queue.cc:260] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } }
I20260928 13:03:50.573609 12854 raft_consensus.cc:388] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:50.573616  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:50.573650 12854 raft_consensus.cc:482] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:50.573691 12854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:50.573820  3096 external_mini_cluster.cc:1428] Setting key c14827aa0ce0057bff0f5750fc55045c
I20260928 13:03:50.574501 12854 raft_consensus.cc:504] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } }
I20260928 13:03:50.574620 12854 leader_election.cc:302] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 270072defc4a43d0a3c5ccab52c5ccd6; no voters: 
I20260928 13:03:50.574771 12854 leader_election.cc:288] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:50.574831 12859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:50.575045 12854 sys_catalog.cc:564] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:50.575086 12859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [term 1 LEADER]: Becoming Leader. State: Replica: 270072defc4a43d0a3c5ccab52c5ccd6, State: Running, Role: LEADER
I20260928 13:03:50.575179 12859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } }
I20260928 13:03:50.575505 12859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 270072defc4a43d0a3c5ccab52c5ccd6. Latest consensus state: current_term: 1 leader_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } } }
I20260928 13:03:50.575575 12859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:50.575742 12861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "270072defc4a43d0a3c5ccab52c5ccd6" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34365 } } }
I20260928 13:03:50.575861 12861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:50.575769 12866 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:50.576538 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.574372 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46006 (local address 127.3.6.62:34365)
0928 13:03:50.574606 (+   234us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.574616 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.574650 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:03:50.574773 (+   123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.574781 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.574828 (+    47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.575287 (+   459us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.575861 (+   574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.575865 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.575866 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.575871 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.575914 (+    43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.575928 (+    14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.576224 (+   296us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.576256 (+    32us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.576316 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260928 13:03:50.576691 12866 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:50.578142 12866 catalog_manager.cc:1347] Generated new cluster ID: 4ea0ebe7d07b4e8595d68c8211f7ff20
I20260928 13:03:50.578202 12866 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:03:50.586014 12866 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:50.586169 12866 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:50.590098 12866 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 270072defc4a43d0a3c5ccab52c5ccd6: Generated new TSK 0
I20260928 13:03:50.590298 12866 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:03:50.596905  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--builtin_ntp_servers=127.3.6.20:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 13:03:50.680310 12878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.680516 12878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.680539 12878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.681773 12878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.681814 12878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.681840 12878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:50.683223 12878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.683450 12878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.683741 12878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.689334 12886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.689333 12884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.689515 12883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.689464 12878 server_base.cc:1034] running on GCE node
I20260928 13:03:50.689770 12878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.690039 12878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.691200 12878 hybrid_clock.cc:648] HybridClock initialized: now 1790600630691187 us; error 30 us; skew 500 ppm
I20260928 13:03:50.692497 12878 webserver.cc:460] Webserver started at http://127.3.6.1:44217/ using document root <none> and password file <none>
I20260928 13:03:50.692740 12878 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.692806 12878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.692941 12878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.693991 12878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "7470a329c9e54107b03bde955fecacd2"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "aeb440676b4d7f82fda27ed6d65741a8"
server_key_iv: "530b2b33ef6b4eef44155b4605f2e48d"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.694366 12878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "7470a329c9e54107b03bde955fecacd2"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "aeb440676b4d7f82fda27ed6d65741a8"
server_key_iv: "530b2b33ef6b4eef44155b4605f2e48d"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.695773 12878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:50.696547 12892 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.696697 12878 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:50.696780 12878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "7470a329c9e54107b03bde955fecacd2"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "aeb440676b4d7f82fda27ed6d65741a8"
server_key_iv: "530b2b33ef6b4eef44155b4605f2e48d"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.696838 12878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.700264 12878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.700564 12878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.700734 12878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.700969 12878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.701306 12878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.701359 12878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.701397 12878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.701426 12878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.706918 12878 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37427
I20260928 13:03:50.706962 13005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37427 every 8 connection(s)
I20260928 13:03:50.707283 12878 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:50.710152 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.707919 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:50333 (local address 127.3.6.62:34365)
0928 13:03:50.707960 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.707962 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.708218 (+   256us) server_negotiation.cc:407] Connection header received
0928 13:03:50.708708 (+   490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.708709 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.708717 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.708773 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.709887 (+  1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.709888 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.709896 (+     8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.709901 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.709917 (+    16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.709921 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.709991 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.710070 (+    79us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.710085 (+    15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:50.710340 13008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.707923 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:34365 (local address 127.3.6.1:50333)
0928 13:03:50.708104 (+   181us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.708134 (+    30us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.708597 (+   463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.708850 (+   253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.708853 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.708868 (+    15us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.709738 (+   870us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.709738 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.709764 (+    26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.709789 (+    25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.709989 (+   200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.709994 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.709997 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.710077 (+    80us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.710135 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260928 13:03:50.710836 13006 heartbeater.cc:347] Connected to a master server at 127.3.6.62:34365
I20260928 13:03:50.710906 13006 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.711066 13006 heartbeater.cc:511] Master 127.3.6.62:34365 requested a full tablet report, sending...
I20260928 13:03:50.711491  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 12878
I20260928 13:03:50.711576  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:50.711584 12818 ts_manager.cc:194] Registered new tserver with Master: 7470a329c9e54107b03bde955fecacd2 (127.3.6.1:37427)
I20260928 13:03:50.711760  3096 external_mini_cluster.cc:1428] Setting key 849e6a4d416755a8d78854fcfc7d6b82
I20260928 13:03:50.712567  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--builtin_ntp_servers=127.3.6.20:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 13:03:50.792013 13009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.792294 13009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.792330 13009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.793525 13009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.793599 13009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.793643 13009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:50.794987 13009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.795323 13009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.795614 13009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.801061 13015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.801102 13014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.801162 13009 server_base.cc:1034] running on GCE node
W20260928 13:03:50.801057 13017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.801617 13009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.801908 13009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.803105 13009 hybrid_clock.cc:648] HybridClock initialized: now 1790600630803080 us; error 36 us; skew 500 ppm
I20260928 13:03:50.804445 13009 webserver.cc:460] Webserver started at http://127.3.6.2:33883/ using document root <none> and password file <none>
I20260928 13:03:50.804703 13009 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.804775 13009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.804940 13009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.806008 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "204b24131e254d59b5e9161167c7db3f"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "fceac2726536c7258af55ea7dfc7ca60"
server_key_iv: "729575eb31486815730016dc734209e3"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.806381 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "204b24131e254d59b5e9161167c7db3f"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "fceac2726536c7258af55ea7dfc7ca60"
server_key_iv: "729575eb31486815730016dc734209e3"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.807771 13009 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:50.808561 13023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.808837 13009 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:03:50.808943 13009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "204b24131e254d59b5e9161167c7db3f"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "fceac2726536c7258af55ea7dfc7ca60"
server_key_iv: "729575eb31486815730016dc734209e3"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.809039 13009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.812358 13009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.812623 13009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.812759 13009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.812973 13009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.813267 13009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.813321 13009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.813360 13009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.813388 13009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.818832 13009 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:39999
I20260928 13:03:50.818919 13136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:39999 every 8 connection(s)
I20260928 13:03:50.819267 13009 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:03:50.822232 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.820061 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:54483 (local address 127.3.6.62:34365)
0928 13:03:50.820123 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.820125 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.820329 (+   204us) server_negotiation.cc:407] Connection header received
0928 13:03:50.820774 (+   445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.820775 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.820779 (+     4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.820848 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.822045 (+  1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.822046 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.822047 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.822050 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.822065 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.822069 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.822121 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.822165 (+    44us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.822177 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:03:50.822458 13139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.820008 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:34365 (local address 127.3.6.2:54483)
0928 13:03:50.820200 (+   192us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.820240 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.820690 (+   450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.820903 (+   213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.820906 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.820915 (+     9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.821895 (+   980us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.821895 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.821924 (+    29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.821954 (+    30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.822118 (+   164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.822120 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.822122 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.822174 (+    52us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.822223 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":97,"threads_started":1}
I20260928 13:03:50.822937 13137 heartbeater.cc:347] Connected to a master server at 127.3.6.62:34365
I20260928 13:03:50.823081 13137 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.823211 13137 heartbeater.cc:511] Master 127.3.6.62:34365 requested a full tablet report, sending...
I20260928 13:03:50.823568 12818 ts_manager.cc:194] Registered new tserver with Master: 204b24131e254d59b5e9161167c7db3f (127.3.6.2:39999)
I20260928 13:03:50.827147  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13009
I20260928 13:03:50.827219  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:50.827419  3096 external_mini_cluster.cc:1428] Setting key d6c0e8584f1ced0fa0df748df5ede04a
I20260928 13:03:50.828301  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--builtin_ntp_servers=127.3.6.20:33689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 13:03:50.908133 13140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:50.908337 13140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:50.908360 13140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:50.909535 13140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:50.909578 13140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:50.909633 13140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:50.910981 13140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:33689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:34365
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:50.911299 13140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:50.911643 13140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:50.916708 13146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.916826 13140 server_base.cc:1034] running on GCE node
W20260928 13:03:50.916750 13148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:50.916917 13145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:50.917161 13140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:50.917369 13140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:50.918511 13140 hybrid_clock.cc:648] HybridClock initialized: now 1790600630918484 us; error 43 us; skew 500 ppm
I20260928 13:03:50.919698 13140 webserver.cc:460] Webserver started at http://127.3.6.3:34397/ using document root <none> and password file <none>
I20260928 13:03:50.919896 13140 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:50.919935 13140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:50.920022 13140 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:50.921044 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "d89af15b8256499383da1caa3e270fba"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "bd99958dfbd51ff93e77c3d3067510f2"
server_key_iv: "943f9c0130830247b2a54d4435077889"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.921339 13140 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "d89af15b8256499383da1caa3e270fba"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "bd99958dfbd51ff93e77c3d3067510f2"
server_key_iv: "943f9c0130830247b2a54d4435077889"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.922602 13140 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:03:50.923316 13154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.923470 13140 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:50.923539 13140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "d89af15b8256499383da1caa3e270fba"
format_stamp: "Formatted at 2026-09-28 13:03:50 on dist-test-slave-ddvw"
server_key: "bd99958dfbd51ff93e77c3d3067510f2"
server_key_iv: "943f9c0130830247b2a54d4435077889"
server_key_version: "encryptionkey@0"
I20260928 13:03:50.923586 13140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:50.926753 13140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:50.926960 13140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:50.927115 13140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:50.927273 13140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:50.927505 13140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:50.927536 13140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.927558 13140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:50.927572 13140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:50.933272 13140 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45343
I20260928 13:03:50.933318 13267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45343 every 8 connection(s)
I20260928 13:03:50.933630 13140 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:50.936525 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.934295 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37065 (local address 127.3.6.62:34365)
0928 13:03:50.934357 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.934360 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.934665 (+   305us) server_negotiation.cc:407] Connection header received
0928 13:03:50.935180 (+   515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.935181 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.935187 (+     6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.935247 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.936322 (+  1075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:50.936323 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:50.936323 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:03:50.936327 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:50.936341 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:03:50.936345 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:50.936397 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:50.936456 (+    59us) server_negotiation.cc:299] Negotiation successful
0928 13:03:50.936470 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:03:50.936703 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:50.934295 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:34365 (local address 127.3.6.3:37065)
0928 13:03:50.934499 (+   204us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:50.934558 (+    59us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:50.935065 (+   507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:50.935301 (+   236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:50.935304 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:50.935311 (+     7us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:50.936182 (+   871us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:03:50.936183 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:50.936211 (+    28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:03:50.936238 (+    27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:50.936397 (+   159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:50.936399 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:50.936401 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:03:50.936452 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:03:50.936498 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":101,"threads_started":1}
I20260928 13:03:50.937180 13268 heartbeater.cc:347] Connected to a master server at 127.3.6.62:34365
I20260928 13:03:50.937253 13268 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:50.937412 13268 heartbeater.cc:511] Master 127.3.6.62:34365 requested a full tablet report, sending...
I20260928 13:03:50.937759 12818 ts_manager.cc:194] Registered new tserver with Master: d89af15b8256499383da1caa3e270fba (127.3.6.3:45343)
I20260928 13:03:50.942677  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13140
I20260928 13:03:50.942783  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:50.942983  3096 external_mini_cluster.cc:1428] Setting key 97b3bfa7d1ff35d3145de9f92c5f3ad8
I20260928 13:03:50.943863  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 13:03:50.945650 12858 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:03:50.945181 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46008 (local address 127.3.6.62:34365)
0928 13:03:50.945231 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:50.945234 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:50.945323 (+    89us) server_negotiation.cc:407] Connection header received
0928 13:03:50.945374 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:50.945375 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:50.945379 (+     4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:50.945439 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:50.945584 (+   145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46008: BlockingRecv error: recv got EOF from 127.0.0.1:46008 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:03:50.945680  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12878
I20260928 13:03:50.950160  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13009
I20260928 13:03:50.954535  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13140
I20260928 13:03:50.958859  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 12787
2026-09-28T13:03:50Z chronyd exiting
[       OK ] SecurityITest.TestRequireEncryptionInsecureCluster (525 ms)
[ RUN      ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:51 dist-test-slave-ddvw krb5kdc[13278](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:51 dist-test-slave-ddvw krb5kdc[13278](info): set up 2 sockets
Sep 28 13:03:51 dist-test-slave-ddvw krb5kdc[13278](info): commencing operation
krb5kdc: starting...
W20260928 13:03:52.020038  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.042s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:03:52.137324  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35453
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:39861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:35453
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:52.216593 13291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:52.216799 13291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:52.216821 13291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:52.217895 13291 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:03:52.217928 13291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:52.217942 13291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:52.217954 13291 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:03:52.217967 13291 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:03:52.219363 13291 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:39861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:35453
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:52.219558 13291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:52.219743 13291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:52.224740 13297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.224781 13291 server_base.cc:1034] running on GCE node
W20260928 13:03:52.224749 13296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.224718 13299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.225180 13291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:52.225572 13291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:52.226800 13291 hybrid_clock.cc:648] HybridClock initialized: now 1790600632226773 us; error 41 us; skew 500 ppm
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:52.229523 13291 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:03:52.230026 13291 webserver.cc:460] Webserver started at http://127.3.6.62:40403/ using document root <none> and password file <none>
I20260928 13:03:52.230262 13291 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:52.230340 13291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:52.230489 13291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:52.231688 13291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "0efc4656bd414d61b2b10eec08660390"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "2938826ed521853e37b2625bf379b78d"
server_key_iv: "65329ecbdb44f23f9f683c28111ba501"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.232070 13291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "0efc4656bd414d61b2b10eec08660390"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "2938826ed521853e37b2625bf379b78d"
server_key_iv: "65329ecbdb44f23f9f683c28111ba501"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.233392 13291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:52.234140 13306 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.234310 13291 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:52.234414 13291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "0efc4656bd414d61b2b10eec08660390"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "2938826ed521853e37b2625bf379b78d"
server_key_iv: "65329ecbdb44f23f9f683c28111ba501"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.234489 13291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:52.245464 13291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:52.247872 13291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:52.248062 13291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:52.251907 13291 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:35453
I20260928 13:03:52.251940 13358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:35453 every 8 connection(s)
I20260928 13:03:52.252281 13291 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:03:52.253257 13359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:52.255484 13359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: Bootstrap starting.
I20260928 13:03:52.256000 13359 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:52.256238 13359 log.cc:824] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:52.256918 13359 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: No bootstrap required, opened a new log
I20260928 13:03:52.258447 13359 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } }
I20260928 13:03:52.258585 13359 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:52.258607 13359 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0efc4656bd414d61b2b10eec08660390, State: Initialized, Role: FOLLOWER
I20260928 13:03:52.258749 13359 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } }
I20260928 13:03:52.258831 13359 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:03:52.258853 13359 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:03:52.258882 13359 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:52.259667 13359 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } }
I20260928 13:03:52.259754 13359 leader_election.cc:302] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0efc4656bd414d61b2b10eec08660390; no voters: 
I20260928 13:03:52.259902 13359 leader_election.cc:288] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:03:52.259930 13362 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:52.260037 13362 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [term 1 LEADER]: Becoming Leader. State: Replica: 0efc4656bd414d61b2b10eec08660390, State: Running, Role: LEADER
I20260928 13:03:52.260166 13359 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:03:52.260164 13362 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } }
I20260928 13:03:52.260593 13364 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0efc4656bd414d61b2b10eec08660390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } } }
I20260928 13:03:52.260639 13363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0efc4656bd414d61b2b10eec08660390. Latest consensus state: current_term: 1 leader_uuid: "0efc4656bd414d61b2b10eec08660390" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0efc4656bd414d61b2b10eec08660390" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35453 } } }
I20260928 13:03:52.260762 13363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:52.260994 13371 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:03:52.261209 13364 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390 [sys.catalog]: This master's current role is: LEADER
I20260928 13:03:52.261538 13371 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:03:52.261932  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13291
I20260928 13:03:52.262007  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:03:52.262203  3096 external_mini_cluster.cc:1428] Setting key 0312a844ff0baf141d984871d9539da7
I20260928 13:03:52.263790 13371 catalog_manager.cc:1347] Generated new cluster ID: 73368284772a4a6083d0630b321d9cf7
I20260928 13:03:52.263844 13371 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:52.273968 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.262899 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53812 (local address 127.3.6.62:35453)
0928 13:03:52.263071 (+   172us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.263080 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.263118 (+    38us) server_negotiation.cc:407] Connection header received
0928 13:03:52.263233 (+   115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.263241 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.263298 (+    57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.263400 (+   102us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:52.264146 (+   746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.265504 (+  1358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.266576 (+  1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.267207 (+   631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.267302 (+    95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.270205 (+  2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:52.270210 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:52.270210 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:52.270223 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:52.272295 (+  2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.272693 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.272696 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.272696 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.272811 (+   115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.273018 (+   207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.273019 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.273019 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.273337 (+   318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:52.273484 (+   147us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.273587 (+   103us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.273728 (+   141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260928 13:03:52.277645 13371 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:03:52.278355 13371 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:03:52.281694 13371 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: Generated new TSK 0
I20260928 13:03:52.281881 13371 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:03:52.305258  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:39861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:52.386866 13385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:52.387120 13385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:52.387146 13385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:52.388312 13385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:52.388352 13385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:52.388378 13385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:03:52.389868 13385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:39861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:52.390123 13385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:52.390389 13385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:52.395355 13393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.395370 13390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.395469 13385 server_base.cc:1034] running on GCE node
W20260928 13:03:52.395431 13391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.395730 13385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:52.395964 13385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:52.397104 13385 hybrid_clock.cc:648] HybridClock initialized: now 1790600632397091 us; error 28 us; skew 500 ppm
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:52.399581 13385 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:03:52.399997 13385 webserver.cc:460] Webserver started at http://127.3.6.1:40131/ using document root <none> and password file <none>
I20260928 13:03:52.400219 13385 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:52.400288 13385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:52.400435 13385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:52.401438 13385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "dc0dccb5a7bb42e08372b5ea01f640bd"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "8837797cdb93ed93617e259518caa989"
server_key_iv: "7a7606900833002165130437250087ef"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.401803 13385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "dc0dccb5a7bb42e08372b5ea01f640bd"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "8837797cdb93ed93617e259518caa989"
server_key_iv: "7a7606900833002165130437250087ef"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.403110 13385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:03:52.403797 13400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.403947 13385 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:03:52.404085 13385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "dc0dccb5a7bb42e08372b5ea01f640bd"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "8837797cdb93ed93617e259518caa989"
server_key_iv: "7a7606900833002165130437250087ef"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.404166 13385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:52.418802 13385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:52.420624 13385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:52.420740 13385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:52.420977 13385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:52.421257 13385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:52.421288 13385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.421309 13385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:52.421321 13385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.426911 13385 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:46127
I20260928 13:03:52.426985 13513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:46127 every 8 connection(s)
I20260928 13:03:52.427320 13385 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:03:52.429648  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13385
I20260928 13:03:52.429737  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:03:52.429921  3096 external_mini_cluster.cc:1428] Setting key a21d5356f1b9c7b94b540fbf32e083a3
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:52.437364 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.428063 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:36259 (local address 127.3.6.62:35453)
0928 13:03:52.428112 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.428115 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.428314 (+   199us) server_negotiation.cc:407] Connection header received
0928 13:03:52.428775 (+   461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.428776 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.428785 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.428838 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:52.429855 (+  1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.430468 (+   613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.431565 (+  1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.431914 (+   349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.431999 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.434375 (+  2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:52.434377 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:52.434377 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:52.434388 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:52.435890 (+  1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.436332 (+   442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.436334 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.436335 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.436396 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.436663 (+   267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.436664 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.436664 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.436781 (+   117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:52.436862 (+    81us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.437182 (+   320us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.437271 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:03:52.437537 13516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.428053 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35453 (local address 127.3.6.1:36259)
0928 13:03:52.428197 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.428230 (+    33us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.428694 (+   464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.428888 (+   194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.428891 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.429444 (+   553us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:52.429763 (+   319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.429769 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.430577 (+   808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.430578 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.431481 (+   903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.431484 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.432006 (+   522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.432020 (+    14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.432174 (+   154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.432696 (+   522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:52.432707 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:52.434275 (+  1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:52.435994 (+  1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.436001 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.436003 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.436240 (+   237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.436465 (+   225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.436466 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.436466 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.436579 (+   113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.436852 (+   273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:52.436858 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:52.437004 (+   146us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.437149 (+   145us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.437310 (+   161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260928 13:03:52.438024 13514 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35453
I20260928 13:03:52.438107 13514 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:52.438320 13514 heartbeater.cc:511] Master 127.3.6.62:35453 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:03:52.438874 13323 ts_manager.cc:194] Registered new tserver with Master: dc0dccb5a7bb42e08372b5ea01f640bd (127.3.6.1:46127)
I20260928 13:03:52.439576 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:36259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:03:52.454907  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:39861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:52.538745 13519 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:52.538949 13519 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:52.539016 13519 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:52.540196 13519 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:52.540239 13519 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:52.540266 13519 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:03:52.541572 13519 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:39861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13519
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:52.541749 13519 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:52.541911 13519 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:52.546785 13524 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.546754 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.546741 13527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.546788 13519 server_base.cc:1034] running on GCE node
I20260928 13:03:52.547180 13519 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:52.547418 13519 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:52.548588 13519 hybrid_clock.cc:648] HybridClock initialized: now 1790600632548579 us; error 31 us; skew 500 ppm
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:52.551204 13519 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:03:52.551649 13519 webserver.cc:460] Webserver started at http://127.3.6.2:36179/ using document root <none> and password file <none>
I20260928 13:03:52.551824 13519 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:52.551862 13519 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:52.551946 13519 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:52.552902 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "7fed6dd298bc4fcca8daacdbd509189e"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "a51588175df93f4bb73f83172b8721b8"
server_key_iv: "e116ad62942ddc0091d016211d90bba5"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.553221 13519 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "7fed6dd298bc4fcca8daacdbd509189e"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "a51588175df93f4bb73f83172b8721b8"
server_key_iv: "e116ad62942ddc0091d016211d90bba5"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.554438 13519 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:03:52.555135 13534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.555303 13519 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.555399 13519 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "7fed6dd298bc4fcca8daacdbd509189e"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "a51588175df93f4bb73f83172b8721b8"
server_key_iv: "e116ad62942ddc0091d016211d90bba5"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.555483 13519 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:52.572584 13519 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:52.574855 13519 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:52.575042 13519 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:52.575274 13519 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:52.575574 13519 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:52.575629 13519 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.575668 13519 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:52.575695 13519 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.581547 13519 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:33731
I20260928 13:03:52.581604 13647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:33731 every 8 connection(s)
I20260928 13:03:52.581934 13519 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:52.589756  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13519
I20260928 13:03:52.589897  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:03:52.590111  3096 external_mini_cluster.cc:1428] Setting key 8f3fa23d77d315619d15a93d01ad0b92
I20260928 13:03:52.591768 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.582684 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:59237 (local address 127.3.6.62:35453)
0928 13:03:52.582746 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.582749 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.582929 (+   180us) server_negotiation.cc:407] Connection header received
0928 13:03:52.583494 (+   565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.583496 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.583507 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.583561 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:52.584450 (+   889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.584941 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.585923 (+   982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.586122 (+   199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.586194 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.588271 (+  2077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:52.588273 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:52.588273 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:52.588280 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:52.590157 (+  1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.590589 (+   432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.590590 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.590590 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.590721 (+   131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.591121 (+   400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.591123 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.591123 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.591239 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:52.591320 (+    81us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.591594 (+   274us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.591682 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 13:03:52.591950 13650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.582657 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35453 (local address 127.3.6.2:59237)
0928 13:03:52.582807 (+   150us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.582850 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.583390 (+   540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.583632 (+   242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.583636 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.584177 (+   541us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:52.584356 (+   179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.584361 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.585032 (+   671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.585033 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.585821 (+   788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.585823 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.586201 (+   378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.586211 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.586332 (+   121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.586758 (+   426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:52.586765 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:52.588179 (+  1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:52.590253 (+  2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.590260 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.590262 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.590519 (+   257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.590881 (+   362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.590881 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.590882 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.590980 (+    98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.591310 (+   330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:52.591316 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:52.591451 (+   135us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.591552 (+   101us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.591706 (+   154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260928 13:03:52.592540 13648 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35453
I20260928 13:03:52.592633 13648 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:52.592820 13648 heartbeater.cc:511] Master 127.3.6.62:35453 requested a full tablet report, sending...
I20260928 13:03:52.593171 13323 ts_manager.cc:194] Registered new tserver with Master: 7fed6dd298bc4fcca8daacdbd509189e (127.3.6.2:33731)
I20260928 13:03:52.593508 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:59237
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:03:52.615533  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:39861
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:03:52.706231 13653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:03:52.706475 13653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:03:52.706499 13653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:03:52.707847 13653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:03:52.707891 13653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:03:52.707921 13653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:03:52.709442 13653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:39861
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35453
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:03:52.709630 13653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:03:52.709820 13653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:03:52.714995 13658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.715003 13661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:03:52.715003 13659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:03:52.715284 13653 server_base.cc:1034] running on GCE node
I20260928 13:03:52.715466 13653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:03:52.715664 13653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:03:52.716817 13653 hybrid_clock.cc:648] HybridClock initialized: now 1790600632716803 us; error 30 us; skew 500 ppm
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:03:52.719498 13653 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:03:52.719933 13653 webserver.cc:460] Webserver started at http://127.3.6.3:37519/ using document root <none> and password file <none>
I20260928 13:03:52.720168 13653 fs_manager.cc:359] Metadata directory not provided
I20260928 13:03:52.720237 13653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:03:52.720386 13653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:03:52.721432 13653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "ba7b01d218ef45f8ae4ebb104c58db1a"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "6ed8bc00798bb98f55d9d0a512dcae95"
server_key_iv: "79ab77ad5f48146fcacbef01bf646965"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.721794 13653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "ba7b01d218ef45f8ae4ebb104c58db1a"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "6ed8bc00798bb98f55d9d0a512dcae95"
server_key_iv: "79ab77ad5f48146fcacbef01bf646965"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.723204 13653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:03:52.723970 13668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.724152 13653 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:03:52.724254 13653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "ba7b01d218ef45f8ae4ebb104c58db1a"
format_stamp: "Formatted at 2026-09-28 13:03:52 on dist-test-slave-ddvw"
server_key: "6ed8bc00798bb98f55d9d0a512dcae95"
server_key_iv: "79ab77ad5f48146fcacbef01bf646965"
server_key_version: "encryptionkey@0"
I20260928 13:03:52.724327 13653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:03:52.741355 13653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:03:52.743845 13653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:03:52.743964 13653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:03:52.744153 13653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:03:52.744410 13653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:03:52.744441 13653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.744463 13653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:03:52.744475 13653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:03:52.750298 13653 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:33249
I20260928 13:03:52.750341 13781 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:33249 every 8 connection(s)
I20260928 13:03:52.750698 13653 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:03:52.750855  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 13653
I20260928 13:03:52.751062  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:03:52.751295  3096 external_mini_cluster.cc:1428] Setting key 44f2962a53a193a57ff3fa8f38f684bf
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13278](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600632, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:03:52.760471 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.751722 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:38387 (local address 127.3.6.62:35453)
0928 13:03:52.751805 (+    83us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.751808 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.752053 (+   245us) server_negotiation.cc:407] Connection header received
0928 13:03:52.752556 (+   503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.752557 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.752567 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.752618 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:52.753537 (+   919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.754021 (+   484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.755003 (+   982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.755247 (+   244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.755299 (+    52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.757623 (+  2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:52.757625 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:52.757625 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:52.757632 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:52.759198 (+  1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.759558 (+   360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.759559 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.759559 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.759620 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.759847 (+   227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.759848 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.759849 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.759966 (+   117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:52.760018 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.760274 (+   256us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.760339 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:03:52.760643 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.751733 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35453 (local address 127.3.6.3:38387)
0928 13:03:52.751940 (+   207us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.751985 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.752471 (+   486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.752675 (+   204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.752679 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.753250 (+   571us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:03:52.753460 (+   210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.753465 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.754104 (+   639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.754105 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.754926 (+   821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.754928 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.755310 (+   382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.755320 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.755427 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.756029 (+   602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:03:52.756039 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:03:52.757529 (+  1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:03:52.759264 (+  1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.759270 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.759271 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.759496 (+   225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.759676 (+   180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:03:52.759677 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:03:52.759677 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:03:52.759773 (+    96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:03:52.760021 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:03:52.760026 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:03:52.760145 (+   119us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.760231 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.760351 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":116,"threads_started":1}
I20260928 13:03:52.761250 13782 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35453
I20260928 13:03:52.761368 13782 heartbeater.cc:464] Registering TS with master...
I20260928 13:03:52.761570 13782 heartbeater.cc:511] Master 127.3.6.62:35453 requested a full tablet report, sending...
I20260928 13:03:52.762012 13323 ts_manager.cc:194] Registered new tserver with Master: ba7b01d218ef45f8ae4ebb104c58db1a (127.3.6.3:33249)
I20260928 13:03:52.762389 13323 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:38387
I20260928 13:03:52.763002  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:03:52.770589 13381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.764316 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.3.6.62:35453)
0928 13:03:52.764441 (+   125us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.764443 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.764553 (+   110us) server_negotiation.cc:407] Connection header received
0928 13:03:52.764637 (+    84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.764638 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.764648 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.764692 (+    44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:03:52.765270 (+   578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.765762 (+   492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.766527 (+   765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.766731 (+   204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.766815 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.768053 (+  1238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:03:52.768054 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:03:52.768055 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:03:52.768062 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:03:52.769374 (+  1312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.769748 (+   374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.769749 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.769750 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.769808 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:03:52.770007 (+   199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:03:52.770008 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:03:52.770009 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:03:52.770159 (+   150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:03:52.770263 (+   104us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.770407 (+   144us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.770486 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260928 13:03:52.772168 13323 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:03:52.773833 13323 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:03:52.780861 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776404 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56948 (local address 127.3.6.1:46127)
0928 13:03:52.776579 (+   175us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.776585 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.776935 (+   350us) server_negotiation.cc:407] Connection header received
0928 13:03:52.777013 (+    78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.777016 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.777033 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.777105 (+    72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:52.777333 (+   228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778409 (+  1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.779722 (+  1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780220 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780481 (+   261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780561 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.780702 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.780755 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":99,"threads_started":1}
I20260928 13:03:52.780879 13793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776288 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46127 (local address 127.0.0.1:56948)
0928 13:03:52.776875 (+   587us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.776886 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.776939 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.777187 (+   248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.777188 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.777190 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:52.777246 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.777247 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778506 (+  1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.778514 (+     8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.779656 (+  1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.779658 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780481 (+   823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780483 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.780575 (+    92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780596 (+    21us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.780680 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.780761 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":29,"thread_start_us":41,"threads_started":1}
I20260928 13:03:52.781013 13791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776090 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:33249 (local address 127.0.0.1:35964)
0928 13:03:52.776394 (+   304us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.776434 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.776499 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.777303 (+   804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.777304 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.777307 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:52.777348 (+    41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.777349 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778264 (+   915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.778265 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.779590 (+  1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.779593 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780656 (+  1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780657 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.780718 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780722 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.780768 (+    46us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.780804 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":1,"thread_start_us":56,"threads_started":1}
I20260928 13:03:52.781106 13794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776235 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35964 (local address 127.3.6.3:33249)
0928 13:03:52.777088 (+   853us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.777092 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.777101 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:52.777138 (+    37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.777139 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.777153 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.777223 (+    70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:52.777411 (+   188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778168 (+   757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.779683 (+  1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780387 (+   704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780536 (+   149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780616 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.780918 (+   302us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.780979 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":810,"thread_start_us":98,"threads_started":1}
I20260928 13:03:52.781491 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776225 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.3.6.2:33731)
0928 13:03:52.776618 (+   393us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.776621 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.776631 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:03:52.776675 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.776677 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.776690 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.776775 (+    85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:52.777009 (+   234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778206 (+  1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.779525 (+  1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780255 (+   730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780329 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780389 (+    60us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.781345 (+   956us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.781413 (+    68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":81,"threads_started":1}
I20260928 13:03:52.780898 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.776074 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:33731 (local address 127.0.0.1:42774)
0928 13:03:52.776394 (+   320us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.776434 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.776499 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.776824 (+   325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.776828 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.776830 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:52.776900 (+    70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.776901 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.778317 (+  1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.778318 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.779423 (+  1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.779425 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.780425 (+  1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.780427 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.780572 (+   145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.780593 (+    21us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.780681 (+    88us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.780758 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"mutex_wait_us":38,"thread_start_us":90,"threads_started":1}
I20260928 13:03:52.781864 13716 tablet_service.cc:1467] Processing CreateTablet for tablet aad1ff3fbdb54a81a8a952f67913913b (DEFAULT_TABLE table=test-table [id=02d202691bb34e80ab58b3dc23f7c352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:52.782253 13716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad1ff3fbdb54a81a8a952f67913913b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:52.782279 13448 tablet_service.cc:1467] Processing CreateTablet for tablet aad1ff3fbdb54a81a8a952f67913913b (DEFAULT_TABLE table=test-table [id=02d202691bb34e80ab58b3dc23f7c352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:52.782550 13448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad1ff3fbdb54a81a8a952f67913913b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:52.782521 13582 tablet_service.cc:1467] Processing CreateTablet for tablet aad1ff3fbdb54a81a8a952f67913913b (DEFAULT_TABLE table=test-table [id=02d202691bb34e80ab58b3dc23f7c352]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:03:52.782822 13582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aad1ff3fbdb54a81a8a952f67913913b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:03:52.785100 13796 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: Bootstrap starting.
I20260928 13:03:52.785727 13797 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Bootstrap starting.
I20260928 13:03:52.785813 13796 tablet_bootstrap.cc:654] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:52.786375 13797 tablet_bootstrap.cc:654] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:52.786398 13796 log.cc:824] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:52.786778 13797 log.cc:824] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:52.787118 13798 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Bootstrap starting.
I20260928 13:03:52.787309 13796 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: No bootstrap required, opened a new log
I20260928 13:03:52.787393 13796 ts_tablet_manager.cc:1397] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:03:52.787573 13797 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: No bootstrap required, opened a new log
I20260928 13:03:52.787657 13797 ts_tablet_manager.cc:1397] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:03:52.787752 13798 tablet_bootstrap.cc:654] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Neither blocks nor log segments found. Creating new log.
I20260928 13:03:52.788282 13798 log.cc:824] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:03:52.789077 13798 tablet_bootstrap.cc:492] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: No bootstrap required, opened a new log
I20260928 13:03:52.789150 13798 ts_tablet_manager.cc:1397] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260928 13:03:52.789412 13797 raft_consensus.cc:348] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.789597 13797 raft_consensus.cc:374] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:52.789640 13797 raft_consensus.cc:729] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba7b01d218ef45f8ae4ebb104c58db1a, State: Initialized, Role: FOLLOWER
I20260928 13:03:52.789640 13796 raft_consensus.cc:348] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.789816 13796 raft_consensus.cc:374] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:52.789775 13797 consensus_queue.cc:260] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.789857 13796 raft_consensus.cc:729] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0dccb5a7bb42e08372b5ea01f640bd, State: Initialized, Role: FOLLOWER
I20260928 13:03:52.789983 13796 consensus_queue.cc:260] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.790086 13797 ts_tablet_manager.cc:1428] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:03:52.790092 13782 heartbeater.cc:503] Master 127.3.6.62:35453 was elected leader, sending a full tablet report...
I20260928 13:03:52.790249 13796 ts_tablet_manager.cc:1428] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20260928 13:03:52.790293 13514 heartbeater.cc:503] Master 127.3.6.62:35453 was elected leader, sending a full tablet report...
I20260928 13:03:52.791689 13798 raft_consensus.cc:348] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.791808 13798 raft_consensus.cc:374] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:03:52.791829 13798 raft_consensus.cc:729] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fed6dd298bc4fcca8daacdbd509189e, State: Initialized, Role: FOLLOWER
I20260928 13:03:52.791940 13798 consensus_queue.cc:260] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.792351 13798 ts_tablet_manager.cc:1428] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20260928 13:03:52.792382 13648 heartbeater.cc:503] Master 127.3.6.62:35453 was elected leader, sending a full tablet report...
I20260928 13:03:52.828810 13802 raft_consensus.cc:482] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:03:52.828938 13802 raft_consensus.cc:504] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.829296 13802 leader_election.cc:288] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fed6dd298bc4fcca8daacdbd509189e (127.3.6.2:33731), dc0dccb5a7bb42e08372b5ea01f640bd (127.3.6.1:46127)
W20260928 13:03:52.832528 13649 tablet.cc:2369] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:03:52.833343 13795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.829701 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:60279 (local address 127.3.6.1:46127)
0928 13:03:52.829781 (+    80us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.829783 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.829843 (+    60us) server_negotiation.cc:407] Connection header received
0928 13:03:52.829895 (+    52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.829896 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.829907 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.829997 (+    90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:52.830227 (+   230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.830946 (+   719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.832453 (+  1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.832959 (+   506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.833024 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.833033 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.833220 (+   187us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.833272 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 13:03:52.833349 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.829623 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46127 (local address 127.3.6.3:60279)
0928 13:03:52.829788 (+   165us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.829805 (+    17us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.829850 (+    45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.830130 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.830130 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.830131 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:52.830167 (+    36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.830168 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.831043 (+   875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.831044 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.832340 (+  1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.832344 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.833052 (+   708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.833054 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.833133 (+    79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.833138 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.833192 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.833230 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":33,"thread_start_us":112,"threads_started":1}
I20260928 13:03:52.833510 13792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.829636 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:54411 (local address 127.3.6.2:33731)
0928 13:03:52.829685 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.829687 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.829832 (+   145us) server_negotiation.cc:407] Connection header received
0928 13:03:52.829868 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.829869 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.829886 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.830008 (+   122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:03:52.830134 (+   126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.830879 (+   745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.832499 (+  1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.832981 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.833084 (+   103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.833094 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.833323 (+   229us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.833372 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 13:03:52.833683 13468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad1ff3fbdb54a81a8a952f67913913b" candidate_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" is_pre_election: true
I20260928 13:03:52.833844 13468 raft_consensus.cc:2454] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7b01d218ef45f8ae4ebb104c58db1a in term 0.
I20260928 13:03:52.834117 13669 leader_election.cc:302] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7b01d218ef45f8ae4ebb104c58db1a, dc0dccb5a7bb42e08372b5ea01f640bd; no voters: 
I20260928 13:03:52.834287 13802 raft_consensus.cc:2781] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:03:52.834355 13784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.829470 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:33731 (local address 127.3.6.3:54411)
0928 13:03:52.829536 (+    66us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.829549 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:03:52.829597 (+    48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:03:52.830008 (+   411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:03:52.830009 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:03:52.830010 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:03:52.830070 (+    60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.830071 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.830970 (+   899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.830971 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.832340 (+  1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:03:52.832344 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.833101 (+   757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.833102 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:03:52.833228 (+   126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.833232 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:03:52.833292 (+    60us) client_negotiation.cc:240] Negotiation successful
0928 13:03:52.833334 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"mutex_wait_us":71}
I20260928 13:03:52.834368 13802 raft_consensus.cc:482] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:03:52.834435 13802 raft_consensus.cc:3037] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:52.834723 13602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad1ff3fbdb54a81a8a952f67913913b" candidate_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fed6dd298bc4fcca8daacdbd509189e" is_pre_election: true
I20260928 13:03:52.834873 13602 raft_consensus.cc:2454] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba7b01d218ef45f8ae4ebb104c58db1a in term 0.
I20260928 13:03:52.835305 13802 raft_consensus.cc:504] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.835421 13802 leader_election.cc:288] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [CANDIDATE]: Term 1 election: Requested vote from peers 7fed6dd298bc4fcca8daacdbd509189e (127.3.6.2:33731), dc0dccb5a7bb42e08372b5ea01f640bd (127.3.6.1:46127)
I20260928 13:03:52.835685 13602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad1ff3fbdb54a81a8a952f67913913b" candidate_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fed6dd298bc4fcca8daacdbd509189e"
I20260928 13:03:52.835728 13468 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aad1ff3fbdb54a81a8a952f67913913b" candidate_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd"
I20260928 13:03:52.835772 13602 raft_consensus.cc:3037] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:52.835803 13468 raft_consensus.cc:3037] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:03:52.836678 13602 raft_consensus.cc:2454] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7b01d218ef45f8ae4ebb104c58db1a in term 1.
I20260928 13:03:52.836678 13468 raft_consensus.cc:2454] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba7b01d218ef45f8ae4ebb104c58db1a in term 1.
I20260928 13:03:52.836855 13669 leader_election.cc:302] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba7b01d218ef45f8ae4ebb104c58db1a, dc0dccb5a7bb42e08372b5ea01f640bd; no voters: 
I20260928 13:03:52.836954 13802 raft_consensus.cc:2781] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:03:52.837117 13802 raft_consensus.cc:686] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 1 LEADER]: Becoming Leader. State: Replica: ba7b01d218ef45f8ae4ebb104c58db1a, State: Running, Role: LEADER
I20260928 13:03:52.837189 13802 consensus_queue.cc:237] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } }
I20260928 13:03:52.838093 13322 catalog_manager.cc:5495] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a reported cstate change: term changed from 0 to 1, leader changed from <none> to ba7b01d218ef45f8ae4ebb104c58db1a (127.3.6.3). New cstate: current_term: 1 leader_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba7b01d218ef45f8ae4ebb104c58db1a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33249 } health_report { overall_health: HEALTHY } } }
I20260928 13:03:52.855669 13794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.853159 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35970 (local address 127.3.6.3:33249)
0928 13:03:52.853226 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:03:52.853229 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:03:52.853238 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:03:52.853281 (+    43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:03:52.853282 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:03:52.853301 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:03:52.853381 (+    80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:03:52.853543 (+   162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.854012 (+   469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.854799 (+   787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:03:52.855035 (+   236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:03:52.855119 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:03:52.855309 (+   190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:03:52.855410 (+   101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:03:52.855512 (+   102us) server_negotiation.cc:1035] Waiting for connection context
0928 13:03:52.855537 (+    25us) server_negotiation.cc:299] Negotiation successful
0928 13:03:52.855558 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:03:52.857837 13602 raft_consensus.cc:1261] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 1 FOLLOWER]: Refusing update from remote peer ba7b01d218ef45f8ae4ebb104c58db1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:52.857903 13468 raft_consensus.cc:1261] T aad1ff3fbdb54a81a8a952f67913913b P dc0dccb5a7bb42e08372b5ea01f640bd [term 1 FOLLOWER]: Refusing update from remote peer ba7b01d218ef45f8ae4ebb104c58db1a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:03:52.858386 13806 consensus_queue.cc:1035] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fed6dd298bc4fcca8daacdbd509189e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 33731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:52.858628 13802 consensus_queue.cc:1035] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc0dccb5a7bb42e08372b5ea01f640bd" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:03:52.861915 13811 mvcc.cc:205] Tried to move back new op lower bound from 7334300192182075392 to 7334300192101957632. Current Snapshot: MvccSnapshot[applied={T|T < 7334300192182075392 or (T in {7334300192182075392})}]
I20260928 13:03:52.864107 13323 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:52.864244 13323 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53814:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:03:52.865056 13323 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0efc4656bd414d61b2b10eec08660390: Sending DeleteTablet for 3 replicas of tablet aad1ff3fbdb54a81a8a952f67913913b
I20260928 13:03:52.865407 13716 tablet_service.cc:1514] Processing DeleteTablet for tablet aad1ff3fbdb54a81a8a952f67913913b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:35964
I20260928 13:03:52.865454 13582 tablet_service.cc:1514] Processing DeleteTablet for tablet aad1ff3fbdb54a81a8a952f67913913b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42774
I20260928 13:03:52.865450 13448 tablet_service.cc:1514] Processing DeleteTablet for tablet aad1ff3fbdb54a81a8a952f67913913b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:03:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:56948
I20260928 13:03:52.865680 13818 tablet_replica.cc:330] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: stopping tablet replica
I20260928 13:03:52.865777 13818 raft_consensus.cc:2229] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:03:52.865873 13818 raft_consensus.cc:2258] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:52.865903  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13385
I20260928 13:03:52.866036 13819 tablet_replica.cc:330] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: stopping tablet replica
I20260928 13:03:52.866134 13819 raft_consensus.cc:2229] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:03:52.866225 13819 raft_consensus.cc:2258] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:03:52.866693 13818 ts_tablet_manager.cc:1905] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:52.866909 13819 ts_tablet_manager.cc:1905] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:03:52.868696 13818 ts_tablet_manager.cc:1918] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:52.868783 13818 log.cc:1196] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/aad1ff3fbdb54a81a8a952f67913913b
I20260928 13:03:52.869092 13818 ts_tablet_manager.cc:1939] T aad1ff3fbdb54a81a8a952f67913913b P ba7b01d218ef45f8ae4ebb104c58db1a: Deleting consensus metadata
I20260928 13:03:52.869244 13819 ts_tablet_manager.cc:1918] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:03:52.869364 13819 log.cc:1196] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/aad1ff3fbdb54a81a8a952f67913913b
I20260928 13:03:52.869527 13308 catalog_manager.cc:4841] TS ba7b01d218ef45f8ae4ebb104c58db1a (127.3.6.3:33249): tablet aad1ff3fbdb54a81a8a952f67913913b (table test-table [id=02d202691bb34e80ab58b3dc23f7c352]) successfully deleted
I20260928 13:03:52.869764 13819 ts_tablet_manager.cc:1939] T aad1ff3fbdb54a81a8a952f67913913b P 7fed6dd298bc4fcca8daacdbd509189e: Deleting consensus metadata
I20260928 13:03:52.870285 13307 catalog_manager.cc:4841] TS 7fed6dd298bc4fcca8daacdbd509189e (127.3.6.2:33731): tablet aad1ff3fbdb54a81a8a952f67913913b (table test-table [id=02d202691bb34e80ab58b3dc23f7c352]) successfully deleted
W20260928 13:03:52.874011 13307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:46127 (error 108)
I20260928 13:03:52.874323  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13519
I20260928 13:03:52.874526 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:03:52.874398 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46127 (local address 127.0.0.1:56952)
0928 13:03:52.874451 (+    53us) negotiation.cc:107] Waiting for socket to connect
0928 13:03:52.874484 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 13:03:52.875336 13307 catalog_manager.cc:4584] TS dc0dccb5a7bb42e08372b5ea01f640bd (127.3.6.1:46127): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet aad1ff3fbdb54a81a8a952f67913913b: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46127: connect: Connection refused (error 111)
I20260928 13:03:52.878322  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13653
I20260928 13:03:52.882881  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 13291
2026-09-28T13:03:52Z chronyd exiting
[       OK ] SecurityITest.TestRequireAuthenticationSecureCluster (1924 ms)
[ RUN      ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13824](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13824](info): set up 2 sockets
Sep 28 13:03:52 dist-test-slave-ddvw krb5kdc[13824](info): commencing operation
krb5kdc: starting...
W20260928 13:03:53.928009  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.025s	user 0.001s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:03:54 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:03:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:03:54Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangeradmin_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangeradmin_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangerlookup_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangerlookup_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
I20260928 13:03:54.091813  3096 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.

The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".

Data page checksums are disabled.

creating directory /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.

Success. You can now start the database server using:

    /tmp/dist-test-tasktCerZp/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/postgres -l logfile start

2026-09-28 13:03:56.591 UTC [13854] LOG:  starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-28 13:03:56.591 UTC [13854] LOG:  listening on IPv4 address "127.3.6.20", port 58735
2026-09-28 13:03:56.595 UTC [13854] LOG:  listening on Unix socket "/tmp/.s.PGSQL.58735"
2026-09-28 13:03:56.632 UTC [13857] LOG:  database system was shut down at 2026-09-28 13:03:55 UTC
2026-09-28 13:03:56.636 UTC [13854] LOG:  database system is ready to accept connections
I20260928 13:03:57.595852  3096 mini_postgres.cc:96] Postgres bound to 58735
2026-09-28 13:03:57.601 UTC [13865] FATAL:  database "slave" does not exist
127.3.6.20:58735 - accepting connections
I20260928 13:03:57.602442  3096 mini_ranger.cc:161] Starting Ranger...
I20260928 13:03:57.616936  3096 mini_ranger.cc:84] Created miniranger Postgres user
I20260928 13:03:58.095782  3096 mini_ranger.cc:87] Created ranger Postgres database
I20260928 13:03:58.095875  3096 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin
2026-09-28 13:03:58,394  [I] DB FLAVOR :POSTGRES
2026-09-28 13:03:58,394  [I] --------- Verifying Ranger DB connection ---------
2026-09-28 13:03:58,394  [I] Checking connection..
2026-09-28 13:03:58,394  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select 1;"
2026-09-28 13:03:58,649  [I] Checking connection passed.
2026-09-28 13:03:58,650  [I] --------- Verifying version history table ---------
2026-09-28 13:03:58,650  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:03:58,909  [I] Table x_db_version_h does not exist in database ranger
2026-09-28 13:03:58,910  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:03:59,150  [I] Table x_db_version_h does not exist in database ranger
2026-09-28 13:03:59,150  [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-28 13:03:59,150  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql 
2026-09-28 13:03:59.406 UTC [13929] WARNING:  there is no transaction in progress
2026-09-28 13:03:59,412  [I] create_dbversion_catalog.sql file imported successfully
2026-09-28 13:03:59,413  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:03:59,650  [I] Table x_db_version_h already exists in database 'ranger'
2026-09-28 13:03:59,650  [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 13:03:59,650  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-28 13:03:59,909  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-28 13:04:00,168  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-ddvw.c.gcp-upstream.internal','N') ;"
2026-09-28 13:04:00,408  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 13:04:00,645  [I] Table x_portal_user does not exist in database ranger
2026-09-28 13:04:00,646  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 13:04:00,889  [I] Table x_policy_ref_group does not exist in database ranger
2026-09-28 13:04:00,890  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 13:04:01,138  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 13:04:01,369  [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-28 13:04:01,369  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql 
2026-09-28 13:04:02.369 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.385 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.402 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.417 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.433 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.451 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.518 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.525 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.540 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.550 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.561 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.576 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.585 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.591 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.598 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:02.605 UTC [14037] WARNING:  there is no transaction in progress
2026-09-28 13:04:03,234  [I] ranger_core_db_postgres.sql file imported successfully
2026-09-28 13:04:03,235  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-28 13:04:03,461  [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-28 13:04:03,462  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 13:04:03,700  [I] Table x_portal_user already exists in database 'ranger'
2026-09-28 13:04:03,701  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 13:04:03,957  [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-28 13:04:03,958  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 13:04:04,211  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 13:04:04,449  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-ddvw.c.gcp-upstream.internal';"
2026-09-28 13:04:04,693  [I] CORE_DB_SCHEMA import status has been updated
2026-09-28 13:04:04,694  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-28 13:04:04,936  [I] DB_PATCHES have already been applied
I20260928 13:04:04.941955  3096 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktCerZp/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260928 13:04:04.942050  3096 mini_ranger.cc:193] Using host: 127.3.6.20
I20260928 13:04:04.945071  3096 mini_ranger.cc:227] Ranger admin URL: http://127.3.6.20:41025
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp].
Sep 28, 2026 1:04:05 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260928 13:04:06.147156  3096 mini_ranger.cc:160] Time spent starting Ranger: real 8.545s	user 0.000s	sys 0.009s
Sep 28, 2026 1:04:26 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
  org.apache.ranger.rest
  org.apache.ranger.common
  xa.rest
Sep 28, 2026 1:04:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
  class org.apache.ranger.rest.MetricsREST
  class org.apache.ranger.rest.XKeyREST
  class org.apache.ranger.rest.XAuditREST
  class org.apache.ranger.rest.XUserREST
  class org.apache.ranger.rest.UserREST
  class org.apache.ranger.rest.ServiceREST
  class org.apache.ranger.rest.PublicAPIs
  class org.apache.ranger.rest.TagREST
  class org.apache.ranger.rest.AssetREST
  class org.apache.ranger.rest.RoleREST
  class org.apache.ranger.rest.SecurityZoneREST
  class org.apache.ranger.rest.PublicAPIsv2
Sep 28, 2026 1:04:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
  class org.apache.ranger.common.RangerJAXBContextResolver
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 28, 2026 1:04:26 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 28, 2026 1:04:27 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260928 13:04:28.231124  3096 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangerkms_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/rangerkms_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.6.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.6.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 28 13:04:28 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM: 
I20260928 13:04:28.310729  3096 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260928 13:04:28.319756  3096 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260928 13:04:29.198491  3096 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260928 13:04:29.198596  3096 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms
I20260928 13:04:29.198619  3096 mini_ranger_kms.cc:227] Using postgres at 127.3.6.20:58735
2026-09-28 13:04:29,372  [I] DB FLAVOR :POSTGRES
2026-09-28 13:04:29,372  [I] --------- Verifying Ranger DB connection ---------
2026-09-28 13:04:29,373  [I] Checking connection
2026-09-28 13:04:29,373  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-28 13:04:29,613  [I] connection success
2026-09-28 13:04:29,614  [I] --------- Verifying Ranger DB tables ---------
2026-09-28 13:04:29,614  [I] Verifying table ranger_masterkey in database rangerkms
2026-09-28 13:04:29,614  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-28 13:04:29,846  [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-28 13:04:29,846  [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 13:04:29,846  [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-28 13:04:29,847  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:58735/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-28 13:04:30,129  [I] kms_core_db_postgres.sql DB schema imported successfully
I20260928 13:04:30.594070  3096 mini_ranger_kms.cc:310] Created kms service
I20260928 13:04:30.753772  3096 mini_ranger_kms.cc:326] Created kudu user
I20260928 13:04:30.797839  3096 mini_ranger_kms.cc:343] Created rangerkms user
Sep 28 13:04:30 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600668, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:04:31.209887  3096 mini_ranger_kms.cc:384] Added ranger policy
I20260928 13:04:31.210144  3096 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260928 13:04:31.210175  3096 mini_ranger_kms.cc:240] Using host: 127.3.6.20
I20260928 13:04:31.213330  3096 mini_ranger_kms.cc:276] Ranger KMS PID: 14217
I20260928 13:04:31.213464  3096 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.6.20:52993
Sep 28, 2026 1:04:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 1:04:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 1:04:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 28, 2026 1:04:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 28, 2026 1:04:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp].
Sep 28, 2026 1:04:33 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260928 13:04:33.491124  3096 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.180s	user 0.009s	sys 0.146s
I20260928 13:04:33.491235  3096 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260928 13:04:33.491318  3096 mini_ranger_kms.cc:401] 127.3.6.20:52993/kms/v1/keys
Sep 28 13:04:33 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790600673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 28 13:04:34 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
Sep 28 13:04:34 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600673, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
Sep 28 13:04:36 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:04:36.841619  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37173
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:32771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37173
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:52993/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:04:36.924237 14268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:04:36.924446 14268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:04:36.924475 14268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:04:36.925631 14268 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:04:36.925671 14268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:04:36.925685 14268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:04:36.925698 14268 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:04:36.925710 14268 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:04:36.927368 14268 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:32771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.6.20:52993/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37173
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:04:36.927608 14268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:04:36.927841 14268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:04:36.933944 14274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:36.933951 14273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:36.934054 14276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:04:36.933987 14268 server_base.cc:1034] running on GCE node
I20260928 13:04:36.934526 14268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:04:36.934824 14268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:04:36.935992 14268 hybrid_clock.cc:648] HybridClock initialized: now 1790600676935968 us; error 46 us; skew 500 ppm
Sep 28 13:04:36 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600676, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:04:36.941948 14268 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:04:36.942451 14268 webserver.cc:460] Webserver started at http://127.3.6.62:41625/ using document root <none> and password file <none>
I20260928 13:04:36.942688 14268 fs_manager.cc:359] Metadata directory not provided
I20260928 13:04:36.942725 14268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:04:36.942857 14268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:04:36 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600676, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:04:36.995344 14268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "371453c92d264f35b7c902508110dc4e"
format_stamp: "Formatted at 2026-09-28 13:04:36 on dist-test-slave-ddvw"
server_key: "f7a0f4c80822a4417750c34f1495ea0e"
server_key_iv: "0a85fbc755ef2ee6e9ff390e06d489b7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:36.995862 14268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "371453c92d264f35b7c902508110dc4e"
format_stamp: "Formatted at 2026-09-28 13:04:36 on dist-test-slave-ddvw"
server_key: "f7a0f4c80822a4417750c34f1495ea0e"
server_key_iv: "0a85fbc755ef2ee6e9ff390e06d489b7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:36.997804 14268 fs_manager.cc:691] Time spent creating directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:04:37.009550 14283 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:37.009763 14268 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:04:37.009842 14268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "371453c92d264f35b7c902508110dc4e"
format_stamp: "Formatted at 2026-09-28 13:04:36 on dist-test-slave-ddvw"
server_key: "f7a0f4c80822a4417750c34f1495ea0e"
server_key_iv: "0a85fbc755ef2ee6e9ff390e06d489b7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:37.009936 14268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:04:37.026870 14268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:04:37.029496 14268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:04:37.029665 14268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:04:37.033864 14268 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:37173
I20260928 13:04:37.033914 14335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:37173 every 8 connection(s)
I20260928 13:04:37.034708 14268 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:04:37.035519 14336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:04:37.037617  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 14268
I20260928 13:04:37.037717  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:04:37.037912  3096 external_mini_cluster.cc:1428] Setting key dd8adee222088e6b5d7ae9653ebfc024
I20260928 13:04:37.038905 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: Bootstrap starting.
I20260928 13:04:37.039645 14336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: Neither blocks nor log segments found. Creating new log.
I20260928 13:04:37.039986 14336 log.cc:824] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:04:37.040814 14336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: No bootstrap required, opened a new log
I20260928 13:04:37.043314 14336 raft_consensus.cc:348] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } }
I20260928 13:04:37.043499 14336 raft_consensus.cc:374] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:04:37.043536 14336 raft_consensus.cc:729] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371453c92d264f35b7c902508110dc4e, State: Initialized, Role: FOLLOWER
I20260928 13:04:37.043707 14336 consensus_queue.cc:260] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } }
I20260928 13:04:37.043800 14336 raft_consensus.cc:388] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:04:37.043840 14336 raft_consensus.cc:482] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:04:37.043911 14336 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 0 FOLLOWER]: Advancing to term 1
Sep 28 13:04:37 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:04:37.045348 14336 raft_consensus.cc:504] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } }
I20260928 13:04:37.045459 14336 leader_election.cc:302] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 371453c92d264f35b7c902508110dc4e; no voters: 
I20260928 13:04:37.045678 14336 leader_election.cc:288] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:04:37.045735 14341 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:04:37.045905 14341 raft_consensus.cc:686] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [term 1 LEADER]: Becoming Leader. State: Replica: 371453c92d264f35b7c902508110dc4e, State: Running, Role: LEADER
I20260928 13:04:37.045962 14336 sys_catalog.cc:564] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:04:37.046334 14341 consensus_queue.cc:237] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } }
I20260928 13:04:37.046736 14341 sys_catalog.cc:455] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 371453c92d264f35b7c902508110dc4e. Latest consensus state: current_term: 1 leader_uuid: "371453c92d264f35b7c902508110dc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } } }
I20260928 13:04:37.046866 14341 sys_catalog.cc:458] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [sys.catalog]: This master's current role is: LEADER
I20260928 13:04:37.047462 14336 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260928 13:04:37.047762 14342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "371453c92d264f35b7c902508110dc4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "371453c92d264f35b7c902508110dc4e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37173 } } }
I20260928 13:04:37.051106 14342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e [sys.catalog]: This master's current role is: LEADER
I20260928 13:04:37.051692 14339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:37.038429 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53540 (local address 127.3.6.62:37173)
0928 13:04:37.038620 (+   191us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:37.038629 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:37.038660 (+    31us) server_negotiation.cc:407] Connection header received
0928 13:04:37.039161 (+   501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:37.039168 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:37.039218 (+    50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:37.039366 (+   148us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:04:37.040048 (+   682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.041179 (+  1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.041948 (+   769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.042368 (+   420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.042489 (+   121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:37.045079 (+  2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:04:37.045083 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:04:37.045083 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:04:37.045100 (+    17us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:04:37.047188 (+  2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:37.047596 (+   408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:37.047599 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:37.047599 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:37.047693 (+    94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:37.047907 (+   214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:37.047908 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:37.047908 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:37.048190 (+   282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:04:37.050644 (+  2454us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:37.051089 (+   445us) server_negotiation.cc:299] Negotiation successful
0928 13:04:37.051488 (+   399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":81,"threads_started":1}
I20260928 13:04:37.052686 14351 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:04:37.053206 14351 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:04:37.055056 14351 catalog_manager.cc:1347] Generated new cluster ID: 5caa7ad9a2f4436b8299b047ef6a8618
I20260928 13:04:37.055111 14351 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:04:37.066051 14351 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:04:37.066847 14351 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:04:37.071287 14351 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: Generated new TSK 0
I20260928 13:04:37.071689 14351 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:04:37.780256  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:52993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:32771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:04:37.876204 14381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:04:37.876430 14381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:04:37.876469 14381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:04:37.877656 14381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:04:37.877724 14381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:04:37.877768 14381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:04:37.879277 14381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:32771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.6.20:52993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:04:37.879530 14381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:04:37.879755 14381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:04:37.885733 14389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:37.885756 14387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:37.886163 14386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:04:37.886385 14381 server_base.cc:1034] running on GCE node
I20260928 13:04:37.886603 14381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:04:37.886861 14381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:04:37.890139 14381 hybrid_clock.cc:648] HybridClock initialized: now 1790600677890109 us; error 46 us; skew 500 ppm
Sep 28 13:04:37 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600677, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:04:37.892864 14381 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:04:37.893321 14381 webserver.cc:460] Webserver started at http://127.3.6.1:44659/ using document root <none> and password file <none>
I20260928 13:04:37.893559 14381 fs_manager.cc:359] Metadata directory not provided
I20260928 13:04:37.893632 14381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:04:37.893786 14381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:04:37 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600677, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:04:37.907791 14381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "db401f506b4d4deb9798aa4e8bb57667"
format_stamp: "Formatted at 2026-09-28 13:04:37 on dist-test-slave-ddvw"
server_key: "569c969a67d2a2470cb92150d9267547"
server_key_iv: "cefeb25dc0043bae8b78efe30fe4e929"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:37.908393 14381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "db401f506b4d4deb9798aa4e8bb57667"
format_stamp: "Formatted at 2026-09-28 13:04:37 on dist-test-slave-ddvw"
server_key: "569c969a67d2a2470cb92150d9267547"
server_key_iv: "cefeb25dc0043bae8b78efe30fe4e929"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:37.911394 14381 fs_manager.cc:691] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.000s
I20260928 13:04:37.930711 14396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:37.930974 14381 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:04:37.931105 14381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "db401f506b4d4deb9798aa4e8bb57667"
format_stamp: "Formatted at 2026-09-28 13:04:37 on dist-test-slave-ddvw"
server_key: "569c969a67d2a2470cb92150d9267547"
server_key_iv: "cefeb25dc0043bae8b78efe30fe4e929"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:37.931221 14381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:04:37.942086 14381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:04:37.944226 14381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:04:37.944379 14381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:04:37.944621 14381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:04:37.944989 14381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:04:37.945043 14381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:37.945106 14381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:04:37.945149 14381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:37.952567 14381 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:46645
I20260928 13:04:37.952908 14381 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:04:37.953315 14509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:46645 every 8 connection(s)
I20260928 13:04:37.958834  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 14381
I20260928 13:04:37.958931  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
Sep 28 13:04:37 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600677, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:04:37.959147  3096 external_mini_cluster.cc:1428] Setting key 7cb6bcb04df8886d26930b7af30c5f6d
I20260928 13:04:37.963261 14512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:37.953767 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37173 (local address 127.3.6.1:47895)
0928 13:04:37.953907 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:37.953947 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:37.954498 (+   551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:37.954777 (+   279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:37.954780 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:37.954950 (+   170us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:04:37.955272 (+   322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:37.955280 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.956044 (+   764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.956045 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:37.956843 (+   798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:37.956845 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.957237 (+   392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.957248 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:37.957380 (+   132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:37.957893 (+   513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:04:37.957901 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:04:37.959328 (+  1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:04:37.961455 (+  2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:37.961462 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:37.961464 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:37.961777 (+   313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:37.962009 (+   232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:37.962010 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:37.962010 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:37.962141 (+   131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:37.962425 (+   284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:04:37.962432 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:04:37.962607 (+   175us) client_negotiation.cc:769] Sending connection context
0928 13:04:37.962712 (+   105us) client_negotiation.cc:240] Negotiation successful
0928 13:04:37.962872 (+   160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":80,"threads_started":1}
I20260928 13:04:37.964048 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:37.954045 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:47895 (local address 127.3.6.62:37173)
0928 13:04:37.954177 (+   132us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:37.954179 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:37.954189 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:04:37.954608 (+   419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:37.954610 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:37.954625 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:37.954698 (+    73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:04:37.955398 (+   700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.955912 (+   514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.956939 (+  1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:37.957157 (+   218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:37.957240 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:37.959446 (+  2206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:04:37.959448 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:04:37.959448 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:04:37.959457 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:04:37.961356 (+  1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:37.961862 (+   506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:37.961863 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:37.961864 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:37.961927 (+    63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:37.962211 (+   284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:37.962212 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:37.962212 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:37.962340 (+   128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:04:37.962398 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:37.963822 (+  1424us) server_negotiation.cc:299] Negotiation successful
0928 13:04:37.963918 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":73,"threads_started":1}
I20260928 13:04:37.964633 14510 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37173
I20260928 13:04:37.964751 14510 heartbeater.cc:464] Registering TS with master...
I20260928 13:04:37.964927 14510 heartbeater.cc:511] Master 127.3.6.62:37173 requested a full tablet report, sending...
I20260928 13:04:37.965466 14300 ts_manager.cc:194] Registered new tserver with Master: db401f506b4d4deb9798aa4e8bb57667 (127.3.6.1:46645)
I20260928 13:04:37.966457 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:47895
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:04:37.987891  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:52993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:32771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:04:38.092012 14518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:04:38.092343 14518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:04:38.092425 14518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:04:38.094712 14518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:04:38.094859 14518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:04:38.094957 14518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:04:38.097548 14518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:32771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.6.20:52993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:04:38.098073 14518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:04:38.098400 14518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:04:38.105522 14528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:38.105607 14526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:38.105695 14525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:04:38.106843 14518 server_base.cc:1034] running on GCE node
I20260928 13:04:38.107132 14518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:04:38.107429 14518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:04:38.108616 14518 hybrid_clock.cc:648] HybridClock initialized: now 1790600678108595 us; error 37 us; skew 500 ppm
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:04:38.111975 14518 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:04:38.112463 14518 webserver.cc:460] Webserver started at http://127.3.6.2:32837/ using document root <none> and password file <none>
I20260928 13:04:38.112756 14518 fs_manager.cc:359] Metadata directory not provided
I20260928 13:04:38.112815 14518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:04:38.112934 14518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:04:38.130671 14518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "ed77026878734967aef683f3f97bd659"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "f95742cd8245771c2e47994c955e3c9d"
server_key_iv: "2df419a7227f2026678c34a867b59bc0"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.131273 14518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "ed77026878734967aef683f3f97bd659"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "f95742cd8245771c2e47994c955e3c9d"
server_key_iv: "2df419a7227f2026678c34a867b59bc0"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.139335 14518 fs_manager.cc:691] Time spent creating directory manager: real 0.008s	user 0.001s	sys 0.000s
I20260928 13:04:38.160426 14535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.164417 14518 fs_manager.cc:725] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.000s
I20260928 13:04:38.164562 14518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "ed77026878734967aef683f3f97bd659"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "f95742cd8245771c2e47994c955e3c9d"
server_key_iv: "2df419a7227f2026678c34a867b59bc0"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.164675 14518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:04:38.180898 14518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:04:38.183521 14518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:04:38.183749 14518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:04:38.184029 14518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:04:38.184463 14518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:04:38.184577 14518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.184657 14518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:04:38.184719 14518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.191954 14518 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:41623
I20260928 13:04:38.192457 14518 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:04:38.194468  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 14518
I20260928 13:04:38.194569  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:04:38.194763  3096 external_mini_cluster.cc:1428] Setting key d37d68e7a86f5d36046db366bf7416b7
I20260928 13:04:38.202435 14648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:41623 every 8 connection(s)
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:04:38.222280 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.203519 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:56203 (local address 127.3.6.62:37173)
0928 13:04:38.203566 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.203569 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.211261 (+  7692us) server_negotiation.cc:407] Connection header received
0928 13:04:38.211979 (+   718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.211981 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.211997 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.212030 (+    33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:04:38.212891 (+   861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.214122 (+  1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.215698 (+  1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.216050 (+   352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.216096 (+    46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.218775 (+  2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:04:38.218776 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:04:38.218777 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:04:38.218785 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:04:38.220603 (+  1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.221119 (+   516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.221120 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.221120 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.221181 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.221482 (+   301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.221484 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.221484 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.221626 (+   142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:04:38.221671 (+    45us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.222084 (+   413us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.222179 (+    95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:04:38.223100 14652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.203218 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37173 (local address 127.3.6.2:56203)
0928 13:04:38.211100 (+  7882us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.211157 (+    57us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.211836 (+   679us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.212232 (+   396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.212237 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.212485 (+   248us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:04:38.212774 (+   289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.212781 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.214246 (+  1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.214247 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.215597 (+  1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.215600 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.216179 (+   579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.216192 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.216348 (+   156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.216993 (+   645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:04:38.217004 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:04:38.218661 (+  1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:04:38.220701 (+  2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:38.220708 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:38.220710 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:38.221020 (+   310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:38.221255 (+   235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:38.221256 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:38.221256 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:38.221397 (+   141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:38.221717 (+   320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:04:38.221723 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:04:38.221904 (+   181us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.222650 (+   746us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.222828 (+   178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7827,"thread_start_us":96,"threads_started":1}
I20260928 13:04:38.223809 14649 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37173
I20260928 13:04:38.223901 14649 heartbeater.cc:464] Registering TS with master...
I20260928 13:04:38.224095 14649 heartbeater.cc:511] Master 127.3.6.62:37173 requested a full tablet report, sending...
I20260928 13:04:38.224496 14300 ts_manager.cc:194] Registered new tserver with Master: ed77026878734967aef683f3f97bd659 (127.3.6.2:41623)
I20260928 13:04:38.224999 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:56203
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:04:38.242676  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:52993/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:32771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:04:38.355209 14654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:04:38.355598 14654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:04:38.355687 14654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:04:38.357602 14654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:04:38.357731 14654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:04:38.357818 14654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:04:38.360142 14654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:32771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.6.20:52993/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37173
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:04:38.360630 14654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:04:38.360960 14654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:04:38.367830 14661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:04:38.368088 14660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:04:38.368152 14654 server_base.cc:1034] running on GCE node
W20260928 13:04:38.367838 14663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:04:38.368479 14654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:04:38.368772 14654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:04:38.369931 14654 hybrid_clock.cc:648] HybridClock initialized: now 1790600678369900 us; error 44 us; skew 500 ppm
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:04:38.373317 14654 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:04:38.373931 14654 webserver.cc:460] Webserver started at http://127.3.6.3:43445/ using document root <none> and password file <none>
I20260928 13:04:38.374219 14654 fs_manager.cc:359] Metadata directory not provided
I20260928 13:04:38.374300 14654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:04:38.374490 14654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:04:38.389683 14654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "382e36e4828f48fbba22ceb0ad20a4df"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "0ed8bdc3f8020c0f3bd18279cb2997cf"
server_key_iv: "fc2da001070b812d75daa0b6113799d7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.390278 14654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "382e36e4828f48fbba22ceb0ad20a4df"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "0ed8bdc3f8020c0f3bd18279cb2997cf"
server_key_iv: "fc2da001070b812d75daa0b6113799d7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.393271 14654 fs_manager.cc:691] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.002s
I20260928 13:04:38.411135 14670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.411501 14654 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.000s
I20260928 13:04:38.411608 14654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "382e36e4828f48fbba22ceb0ad20a4df"
format_stamp: "Formatted at 2026-09-28 13:04:38 on dist-test-slave-ddvw"
server_key: "0ed8bdc3f8020c0f3bd18279cb2997cf"
server_key_iv: "fc2da001070b812d75daa0b6113799d7"
server_key_version: "kuduclusterkey@0"
I20260928 13:04:38.411707 14654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:04:38.430444 14654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:04:38.432907 14654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:04:38.433132 14654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:04:38.433475 14654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:04:38.433909 14654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:04:38.434002 14654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.434079 14654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:04:38.434141 14654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:04:38.441596 14654 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:41009
I20260928 13:04:38.442076 14654 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:04:38.442845 14783 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:41009 every 8 connection(s)
I20260928 13:04:38.443996  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 14654
I20260928 13:04:38.444101  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:04:38.444291  3096 external_mini_cluster.cc:1428] Setting key 24f297e9d228262511fba853e103bde5
Sep 28 13:04:38 dist-test-slave-ddvw krb5kdc[13824](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600678, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:04:38.453410 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.443919 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:57323 (local address 127.3.6.62:37173)
0928 13:04:38.443961 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.443963 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.443974 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:04:38.444585 (+   611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.444588 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.444600 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.444633 (+    33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:04:38.445562 (+   929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.446347 (+   785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.447853 (+  1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.448060 (+   207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.448094 (+    34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.450340 (+  2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:04:38.450342 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:04:38.450342 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:04:38.450350 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:04:38.451985 (+  1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.452431 (+   446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.452433 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.452433 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.452501 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.452743 (+   242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.452744 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.452744 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.452878 (+   134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:04:38.452949 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.453214 (+   265us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.453303 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:04:38.453455 14786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.443609 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37173 (local address 127.3.6.3:57323)
0928 13:04:38.443781 (+   172us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.443824 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.444456 (+   632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.444842 (+   386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.444847 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.445112 (+   265us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:04:38.445415 (+   303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.445423 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.446529 (+  1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.446530 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.447747 (+  1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.447750 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.448157 (+   407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.448167 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.448272 (+   105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.448896 (+   624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:04:38.448913 (+    17us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:04:38.450235 (+  1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:04:38.452073 (+  1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:38.452079 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:38.452102 (+    23us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:38.452349 (+   247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:38.452568 (+   219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:04:38.452569 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:04:38.452569 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:04:38.452678 (+   109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:04:38.452944 (+   266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:04:38.452948 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:04:38.453083 (+   135us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.453167 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.453282 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":107,"threads_started":1}
I20260928 13:04:38.454020 14784 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37173
I20260928 13:04:38.454103 14784 heartbeater.cc:464] Registering TS with master...
I20260928 13:04:38.454298 14784 heartbeater.cc:511] Master 127.3.6.62:37173 requested a full tablet report, sending...
I20260928 13:04:38.454708 14300 ts_manager.cc:194] Registered new tserver with Master: 382e36e4828f48fbba22ceb0ad20a4df (127.3.6.3:41009)
I20260928 13:04:38.455214 14300 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:57323
I20260928 13:04:38.455803  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:04:38.470767 14513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.457086 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53548 (local address 127.3.6.62:37173)
0928 13:04:38.457138 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.457140 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.461920 (+  4780us) server_negotiation.cc:407] Connection header received
0928 13:04:38.461978 (+    58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.461979 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.461992 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.462049 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:04:38.462836 (+   787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.463578 (+   742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.464858 (+  1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.465165 (+   307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.465239 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.467112 (+  1873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:04:38.467113 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:04:38.467113 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:04:38.467123 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:04:38.469409 (+  2286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.469845 (+   436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.469846 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.469847 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.469908 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:04:38.470135 (+   227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:04:38.470136 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:04:38.470136 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:04:38.470271 (+   135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:04:38.470356 (+    85us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.470578 (+   222us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.470668 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 13:04:38.473001 14300 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53548:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:04:38.475065 14300 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:04:38.483793 14796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478086 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41009 (local address 127.0.0.1:35274)
0928 13:04:38.478713 (+   627us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.478757 (+    44us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.478815 (+    58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.479143 (+   328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.479147 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.479149 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:04:38.479253 (+   104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.479256 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.480989 (+  1733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.480990 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.482206 (+  1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.482208 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.483420 (+  1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.483421 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.483536 (+   115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.483558 (+    22us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.483607 (+    49us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.483685 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"mutex_wait_us":44,"thread_start_us":108,"threads_started":1}
I20260928 13:04:38.483978 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478443 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34256 (local address 127.3.6.2:41623)
0928 13:04:38.478615 (+   172us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.478621 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.479321 (+   700us) server_negotiation.cc:407] Connection header received
0928 13:04:38.479373 (+    52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.479375 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.479390 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.479481 (+    91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:04:38.479628 (+   147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.480700 (+  1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.482330 (+  1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.483520 (+  1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.483562 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.483623 (+    61us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.483829 (+   206us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.483876 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":104,"threads_started":1}
I20260928 13:04:38.484197 14799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478355 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41623 (local address 127.0.0.1:34256)
0928 13:04:38.479235 (+   880us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.479242 (+     7us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.479312 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.479477 (+   165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.479477 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.479479 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:04:38.479540 (+    61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.479542 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.480795 (+  1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.480796 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.482206 (+  1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.482208 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.483682 (+  1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.483683 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.483743 (+    60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.483746 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.484063 (+   317us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.484111 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":33,"thread_start_us":69,"threads_started":1}
I20260928 13:04:38.484895 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478187 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35274 (local address 127.3.6.3:41009)
0928 13:04:38.478939 (+   752us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.478942 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.478949 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:04:38.478980 (+    31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.478981 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.478996 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.479130 (+   134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:04:38.479575 (+   445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.480905 (+  1330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.482321 (+  1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.483322 (+  1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.484683 (+  1361us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.484751 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.484778 (+    27us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.484818 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":722,"thread_start_us":79,"threads_started":1}
I20260928 13:04:38.485110 14578 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f (DEFAULT_TABLE table=test-table [id=70db2b38109446129fc20642f47aac72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:04:38.485350 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478121 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46645 (local address 127.0.0.1:42704)
0928 13:04:38.479102 (+   981us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.479111 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.479161 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.479605 (+   444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.479606 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.479608 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:04:38.479655 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.479657 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.481855 (+  2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.481856 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.483523 (+  1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.483527 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.485078 (+  1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.485079 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.485157 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.485162 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.485217 (+    55us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.485265 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":964,"thread_start_us":101,"threads_started":1}
I20260928 13:04:38.485491 14578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe52ccf66ef4079afffb2a227749a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:04:38.485566 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.478547 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42704 (local address 127.3.6.1:46645)
0928 13:04:38.478681 (+   134us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.478687 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.479369 (+   682us) server_negotiation.cc:407] Connection header received
0928 13:04:38.479416 (+    47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.479419 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.479439 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.479523 (+    84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:04:38.479737 (+   214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.481751 (+  2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.483642 (+  1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.484471 (+   829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.484967 (+   496us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.485036 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.485452 (+   416us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.485497 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":88,"threads_started":1}
I20260928 13:04:38.485688 14718 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f (DEFAULT_TABLE table=test-table [id=70db2b38109446129fc20642f47aac72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:04:38.485976 14718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe52ccf66ef4079afffb2a227749a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:04:38.489529 14803 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Bootstrap starting.
I20260928 13:04:38.490625 14803 tablet_bootstrap.cc:654] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Neither blocks nor log segments found. Creating new log.
I20260928 13:04:38.490762 14426 tablet_service.cc:1467] Processing CreateTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f (DEFAULT_TABLE table=test-table [id=70db2b38109446129fc20642f47aac72]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:04:38.490928 14803 log.cc:824] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Log is configured to *not* fsync() on all Append() calls
I20260928 13:04:38.491155 14426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fe52ccf66ef4079afffb2a227749a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:04:38.491300 14802 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: Bootstrap starting.
I20260928 13:04:38.492264 14802 tablet_bootstrap.cc:654] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: Neither blocks nor log segments found. Creating new log.
I20260928 13:04:38.492540 14802 log.cc:824] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: Log is configured to *not* fsync() on all Append() calls
I20260928 13:04:38.493667 14803 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: No bootstrap required, opened a new log
I20260928 13:04:38.493727 14803 ts_tablet_manager.cc:1397] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Time spent bootstrapping tablet: real 0.004s	user 0.002s	sys 0.000s
I20260928 13:04:38.495613 14803 raft_consensus.cc:348] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.495795 14803 raft_consensus.cc:374] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:04:38.495827 14803 raft_consensus.cc:729] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 382e36e4828f48fbba22ceb0ad20a4df, State: Initialized, Role: FOLLOWER
I20260928 13:04:38.495966 14803 consensus_queue.cc:260] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.496237 14803 ts_tablet_manager.cc:1428] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:04:38.496311 14784 heartbeater.cc:503] Master 127.3.6.62:37173 was elected leader, sending a full tablet report...
I20260928 13:04:38.496544 14806 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: Bootstrap starting.
I20260928 13:04:38.498503 14806 tablet_bootstrap.cc:654] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: Neither blocks nor log segments found. Creating new log.
I20260928 13:04:38.498799 14806 log.cc:824] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: Log is configured to *not* fsync() on all Append() calls
I20260928 13:04:38.499643 14802 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: No bootstrap required, opened a new log
I20260928 13:04:38.499723 14802 ts_tablet_manager.cc:1397] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: Time spent bootstrapping tablet: real 0.008s	user 0.002s	sys 0.000s
I20260928 13:04:38.501646 14802 raft_consensus.cc:348] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.501823 14802 raft_consensus.cc:374] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:04:38.501855 14802 raft_consensus.cc:729] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed77026878734967aef683f3f97bd659, State: Initialized, Role: FOLLOWER
I20260928 13:04:38.502012 14802 consensus_queue.cc:260] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.502365 14802 ts_tablet_manager.cc:1428] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20260928 13:04:38.502540 14649 heartbeater.cc:503] Master 127.3.6.62:37173 was elected leader, sending a full tablet report...
I20260928 13:04:38.503230 14806 tablet_bootstrap.cc:492] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: No bootstrap required, opened a new log
I20260928 13:04:38.503311 14806 ts_tablet_manager.cc:1397] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: Time spent bootstrapping tablet: real 0.007s	user 0.002s	sys 0.000s
I20260928 13:04:38.506001 14806 raft_consensus.cc:348] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.506184 14806 raft_consensus.cc:374] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:04:38.506222 14806 raft_consensus.cc:729] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db401f506b4d4deb9798aa4e8bb57667, State: Initialized, Role: FOLLOWER
I20260928 13:04:38.506377 14806 consensus_queue.cc:260] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.506664 14806 ts_tablet_manager.cc:1428] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:04:38.506721 14510 heartbeater.cc:503] Master 127.3.6.62:37173 was elected leader, sending a full tablet report...
I20260928 13:04:38.511708 14810 raft_consensus.cc:482] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:04:38.511873 14810 raft_consensus.cc:504] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.512984 14810 leader_election.cc:288] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 382e36e4828f48fbba22ceb0ad20a4df (127.3.6.3:41009), ed77026878734967aef683f3f97bd659 (127.3.6.2:41623)
I20260928 13:04:38.517241 14798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.512586 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:44197 (local address 127.3.6.3:41009)
0928 13:04:38.512633 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.512635 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.513207 (+   572us) server_negotiation.cc:407] Connection header received
0928 13:04:38.513309 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.513310 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.513319 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.513347 (+    28us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:04:38.513589 (+   242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.514346 (+   757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.515902 (+  1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.516472 (+   570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.516528 (+    56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.516538 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.517124 (+   586us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.517168 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:04:38.517680 14811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.512391 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:41009 (local address 127.3.6.1:44197)
0928 13:04:38.513143 (+   752us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.513154 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.513235 (+    81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.513412 (+   177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.513412 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.513414 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:04:38.513508 (+    94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.513510 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.514462 (+   952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.514463 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.515805 (+  1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.515808 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.516594 (+   786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.516595 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.516666 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.516670 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.517557 (+   887us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.517602 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":98,"threads_started":1}
I20260928 13:04:38.517851 14800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.512926 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:46125 (local address 127.3.6.2:41623)
0928 13:04:38.512964 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.512966 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.514037 (+  1071us) server_negotiation.cc:407] Connection header received
0928 13:04:38.514141 (+   104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.514142 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.514154 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.514183 (+    29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:04:38.514440 (+   257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.515172 (+   732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.516944 (+  1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.517471 (+   527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.517520 (+    49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.517529 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.517746 (+   217us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.517787 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:04:38.518076 14812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.512772 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41623 (local address 127.3.6.1:46125)
0928 13:04:38.513951 (+  1179us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.513962 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:04:38.514066 (+   104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:04:38.514287 (+   221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:04:38.514288 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:04:38.514289 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:04:38.514361 (+    72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.514363 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.515295 (+   932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.515295 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.516762 (+  1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:04:38.516765 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.517592 (+   827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.517592 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:04:38.517665 (+    73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.517669 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:04:38.517946 (+   277us) client_negotiation.cc:240] Negotiation successful
0928 13:04:38.517992 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"thread_start_us":74,"threads_started":1}
I20260928 13:04:38.518157 14731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe52ccf66ef4079afffb2a227749a0f" candidate_uuid: "db401f506b4d4deb9798aa4e8bb57667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e36e4828f48fbba22ceb0ad20a4df" is_pre_election: true
I20260928 13:04:38.518309 14731 raft_consensus.cc:2454] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db401f506b4d4deb9798aa4e8bb57667 in term 0.
I20260928 13:04:38.518653 14600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe52ccf66ef4079afffb2a227749a0f" candidate_uuid: "db401f506b4d4deb9798aa4e8bb57667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed77026878734967aef683f3f97bd659" is_pre_election: true
I20260928 13:04:38.518793 14600 raft_consensus.cc:2454] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db401f506b4d4deb9798aa4e8bb57667 in term 0.
I20260928 13:04:38.519040 14399 leader_election.cc:302] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: db401f506b4d4deb9798aa4e8bb57667, ed77026878734967aef683f3f97bd659; no voters: 
I20260928 13:04:38.519249 14810 raft_consensus.cc:2781] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:04:38.519322 14810 raft_consensus.cc:482] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:04:38.519348 14810 raft_consensus.cc:3037] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:04:38.520267 14810 raft_consensus.cc:504] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.520406 14810 leader_election.cc:288] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [CANDIDATE]: Term 1 election: Requested vote from peers 382e36e4828f48fbba22ceb0ad20a4df (127.3.6.3:41009), ed77026878734967aef683f3f97bd659 (127.3.6.2:41623)
I20260928 13:04:38.520557 14731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe52ccf66ef4079afffb2a227749a0f" candidate_uuid: "db401f506b4d4deb9798aa4e8bb57667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "382e36e4828f48fbba22ceb0ad20a4df"
I20260928 13:04:38.520639 14731 raft_consensus.cc:3037] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:04:38.520650 14600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6fe52ccf66ef4079afffb2a227749a0f" candidate_uuid: "db401f506b4d4deb9798aa4e8bb57667" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed77026878734967aef683f3f97bd659"
I20260928 13:04:38.520721 14600 raft_consensus.cc:3037] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:04:38.521476 14731 raft_consensus.cc:2454] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db401f506b4d4deb9798aa4e8bb57667 in term 1.
I20260928 13:04:38.521562 14600 raft_consensus.cc:2454] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db401f506b4d4deb9798aa4e8bb57667 in term 1.
I20260928 13:04:38.521670 14400 leader_election.cc:302] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 382e36e4828f48fbba22ceb0ad20a4df, db401f506b4d4deb9798aa4e8bb57667; no voters: 
I20260928 13:04:38.521834 14810 raft_consensus.cc:2781] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:04:38.522037 14810 raft_consensus.cc:686] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [term 1 LEADER]: Becoming Leader. State: Replica: db401f506b4d4deb9798aa4e8bb57667, State: Running, Role: LEADER
I20260928 13:04:38.522167 14810 consensus_queue.cc:237] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } }
I20260928 13:04:38.523084 14300 catalog_manager.cc:5495] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 reported cstate change: term changed from 0 to 1, leader changed from <none> to db401f506b4d4deb9798aa4e8bb57667 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "db401f506b4d4deb9798aa4e8bb57667" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "db401f506b4d4deb9798aa4e8bb57667" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 } health_report { overall_health: UNKNOWN } } }
I20260928 13:04:38.532200 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.528971 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.3.6.1:46645)
0928 13:04:38.529013 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:04:38.529015 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:04:38.529023 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:04:38.529057 (+    34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:04:38.529058 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:04:38.529077 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:04:38.529149 (+    72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:04:38.529339 (+   190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.530031 (+   692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.531184 (+  1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:04:38.531527 (+   343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:04:38.531594 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:04:38.531818 (+   224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:04:38.531962 (+   144us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:04:38.532064 (+   102us) server_negotiation.cc:1035] Waiting for connection context
0928 13:04:38.532096 (+    32us) server_negotiation.cc:299] Negotiation successful
0928 13:04:38.532120 (+    24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:04:38.534353 14600 raft_consensus.cc:1261] T 6fe52ccf66ef4079afffb2a227749a0f P ed77026878734967aef683f3f97bd659 [term 1 FOLLOWER]: Refusing update from remote peer db401f506b4d4deb9798aa4e8bb57667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:04:38.534854 14813 consensus_queue.cc:1035] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed77026878734967aef683f3f97bd659" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:04:38.534971 14731 raft_consensus.cc:1261] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 1 FOLLOWER]: Refusing update from remote peer db401f506b4d4deb9798aa4e8bb57667: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:04:38.535413 14813 consensus_queue.cc:1035] T 6fe52ccf66ef4079afffb2a227749a0f P db401f506b4d4deb9798aa4e8bb57667 [LEADER]: Connected to new peer: Peer: permanent_uuid: "382e36e4828f48fbba22ceb0ad20a4df" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 41009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:04:38.538638 14816 mvcc.cc:205] Tried to move back new op lower bound from 7334300379274010624 to 7334300379227824128. Current Snapshot: MvccSnapshot[applied={T|T < 7334300379274010624 or (T in {7334300379274010624})}]
I20260928 13:04:38.540156 14300 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:04:38.540248 14300 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:04:38.541107 14300 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 371453c92d264f35b7c902508110dc4e: Sending DeleteTablet for 3 replicas of tablet 6fe52ccf66ef4079afffb2a227749a0f
I20260928 13:04:38.541539 14578 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:04:38 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:34256
I20260928 13:04:38.541536 14426 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:04:38 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:42704
I20260928 13:04:38.542011 14718 tablet_service.cc:1514] Processing DeleteTablet for tablet 6fe52ccf66ef4079afffb2a227749a0f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:04:38 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:35274
I20260928 13:04:38.542591  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 14381
I20260928 13:04:38.544523 14817 mvcc.cc:205] Tried to move back new op lower bound from 7334300379274010624 to 7334300379227824128. Current Snapshot: MvccSnapshot[applied={T|T < 7334300379274010624}]
I20260928 13:04:38.547178 14825 tablet_replica.cc:330] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: stopping tablet replica
I20260928 13:04:38.547312 14825 raft_consensus.cc:2229] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:04:38.547384 14825 pending_rounds.cc:62] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Trying to abort 2 pending ops.
I20260928 13:04:38.547425 14825 pending_rounds.cc:68] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7334300379274010624 op_type: WRITE_OP write_request { tablet_id: "6fe52ccf66ef4079afffb2a227749a0f" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "val" type: INT32 is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\003\00090\000\0001\324\000\000" indirect_data: "<redacted>""" } external_consistency_mode: CLIENT_PROPAGATED authz_token { token_data: "\010\222\316\351\325\006\"8\n\ntest-admin\022*\n 70db2b38109446129fc20642f47aac72\020\001\030\001 \001(\001" signature: "<redacted>""Vf\203&\332\372p\334\273bQ\212\037\325\022EmG\030\034h\342\274{\374T\240\025\247\177\302\005\252\274\257\206\357\213\036\274\266\274P6\246V\221\256Q,\344\225\262\031\267\317\261\265\276\236\320\365)\272" signing_key_seq_num: 0 } } request_id { client_id: "aa02c172a3ae4648a01d79a491730b63" seq_no: 0 first_incomplete_seq_no: 0 attempt_no: 0 }
I20260928 13:04:38.547683 14825 pending_rounds.cc:68] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7334300379227824128 op_type: NO_OP noop_request { }
I20260928 13:04:38.547744 14825 raft_consensus.cc:2866] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260928 13:04:38.547777 14825 raft_consensus.cc:2258] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:04:38.551544 14825 ts_tablet_manager.cc:1905] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 13:04:38.551932 14674 connection.cc:535] server connection from 127.3.6.1:44197 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 13:04:38.552268 14286 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:46645 (error 108)
I20260928 13:04:38.553051  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 14518
I20260928 13:04:38.555215 14825 ts_tablet_manager.cc:1918] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:04:38.555378 14825 log.cc:1196] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/6fe52ccf66ef4079afffb2a227749a0f
I20260928 13:04:38.555730 14825 ts_tablet_manager.cc:1939] T 6fe52ccf66ef4079afffb2a227749a0f P 382e36e4828f48fbba22ceb0ad20a4df: Deleting consensus metadata
I20260928 13:04:38.556377 14287 catalog_manager.cc:4841] TS 382e36e4828f48fbba22ceb0ad20a4df (127.3.6.3:41009): tablet 6fe52ccf66ef4079afffb2a227749a0f (table test-table [id=70db2b38109446129fc20642f47aac72]) successfully deleted
I20260928 13:04:38.559475 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.559308 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46645 (local address 127.0.0.1:42718)
0928 13:04:38.559363 (+    55us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.559420 (+    57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46645: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260928 13:04:38.559715 14286 catalog_manager.cc:4584] TS db401f506b4d4deb9798aa4e8bb57667 (127.3.6.1:46645): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6fe52ccf66ef4079afffb2a227749a0f: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46645: connect: Connection refused (error 111)
I20260928 13:04:38.561156 14797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:04:38.561029 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41623 (local address 127.0.0.1:34258)
0928 13:04:38.561091 (+    62us) negotiation.cc:107] Waiting for socket to connect
0928 13:04:38.561124 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:41623: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260928 13:04:38.561383  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 14654
I20260928 13:04:38.567239  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 14268
I20260928 13:04:38.574612  3096 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260928 13:04:38.909228  3096 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260928 13:04:38.909354  3096 mini_ranger.cc:66] Stopping Ranger...
I20260928 13:04:39.254645  3096 mini_ranger.cc:68] Stopped Ranger
2026-09-28 13:04:39.254 UTC [13854] LOG:  received smart shutdown request
2026-09-28 13:04:39.258 UTC [13854] LOG:  background worker "logical replication launcher" (PID 13863) exited with exit code 1
2026-09-28 13:04:39.258 UTC [13858] LOG:  shutting down
2026-09-28 13:04:39.428 UTC [13854] LOG:  database system is shut down
2026-09-28T13:04:39Z chronyd exiting
[       OK ] SecurityITest.TestEncryptionWithKMSIntegration (46655 ms)
[ RUN      ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:04:39 dist-test-slave-ddvw krb5kdc[14836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:04:39 dist-test-slave-ddvw krb5kdc[14836](info): set up 2 sockets
Sep 28 13:04:39 dist-test-slave-ddvw krb5kdc[14836](info): commencing operation
krb5kdc: starting...
W20260928 13:04:40.578905  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.020s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:04:40 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:04:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:04:40Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangeradmin_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangeradmin_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangerlookup_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangerlookup_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
I20260928 13:04:40.746366  3096 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.

The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".

Data page checksums are disabled.

creating directory /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok

initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.

Success. You can now start the database server using:

    /tmp/dist-test-tasktCerZp/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/postgres -l logfile start

2026-09-28 13:04:43.291 UTC [14866] LOG:  starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-28 13:04:43.291 UTC [14866] LOG:  listening on IPv4 address "127.3.6.20", port 53875
2026-09-28 13:04:43.295 UTC [14866] LOG:  listening on Unix socket "/tmp/.s.PGSQL.53875"
2026-09-28 13:04:43.316 UTC [14869] LOG:  database system was shut down at 2026-09-28 13:04:41 UTC
2026-09-28 13:04:43.320 UTC [14866] LOG:  database system is ready to accept connections
I20260928 13:04:44.270867  3096 mini_postgres.cc:96] Postgres bound to 53875
2026-09-28 13:04:44.277 UTC [14877] FATAL:  database "slave" does not exist
127.3.6.20:53875 - accepting connections
I20260928 13:04:44.278100  3096 mini_ranger.cc:161] Starting Ranger...
I20260928 13:04:44.292889  3096 mini_ranger.cc:84] Created miniranger Postgres user
I20260928 13:04:44.772900  3096 mini_ranger.cc:87] Created ranger Postgres database
I20260928 13:04:44.772991  3096 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin
2026-09-28 13:04:45,057  [I] DB FLAVOR :POSTGRES
2026-09-28 13:04:45,057  [I] --------- Verifying Ranger DB connection ---------
2026-09-28 13:04:45,057  [I] Checking connection..
2026-09-28 13:04:45,058  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select 1;"
2026-09-28 13:04:45,327  [I] Checking connection passed.
2026-09-28 13:04:45,327  [I] --------- Verifying version history table ---------
2026-09-28 13:04:45,327  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:04:45,571  [I] Table x_db_version_h does not exist in database ranger
2026-09-28 13:04:45,571  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:04:45,835  [I] Table x_db_version_h does not exist in database ranger
2026-09-28 13:04:45,835  [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-28 13:04:45,835  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql 
2026-09-28 13:04:46.081 UTC [14941] WARNING:  there is no transaction in progress
2026-09-28 13:04:46,088  [I] create_dbversion_catalog.sql file imported successfully
2026-09-28 13:04:46,088  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 13:04:46,323  [I] Table x_db_version_h already exists in database 'ranger'
2026-09-28 13:04:46,324  [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 13:04:46,324  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-28 13:04:46,566  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-28 13:04:46,796  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-ddvw.c.gcp-upstream.internal','N') ;"
2026-09-28 13:04:47,023  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 13:04:47,275  [I] Table x_portal_user does not exist in database ranger
2026-09-28 13:04:47,276  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 13:04:47,541  [I] Table x_policy_ref_group does not exist in database ranger
2026-09-28 13:04:47,541  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 13:04:47,797  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 13:04:48,031  [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-28 13:04:48,031  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql 
2026-09-28 13:04:48.991 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.007 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.023 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.038 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.055 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.071 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.127 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.135 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.150 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.161 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.172 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.185 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.195 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.201 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.208 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49.215 UTC [15049] WARNING:  there is no transaction in progress
2026-09-28 13:04:49,867  [I] ranger_core_db_postgres.sql file imported successfully
2026-09-28 13:04:49,867  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-28 13:04:50,098  [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-28 13:04:50,099  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 13:04:50,363  [I] Table x_portal_user already exists in database 'ranger'
2026-09-28 13:04:50,363  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 13:04:50,615  [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-28 13:04:50,616  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 13:04:50,854  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 13:04:51,105  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-ddvw.c.gcp-upstream.internal';"
2026-09-28 13:04:51,329  [I] CORE_DB_SCHEMA import status has been updated
2026-09-28 13:04:51,329  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/ranger -u miniranger -p '********' -noheader -trim -c \;  -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-28 13:04:51,576  [I] DB_PATCHES have already been applied
I20260928 13:04:51.582206  3096 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasktCerZp/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260928 13:04:51.582269  3096 mini_ranger.cc:193] Using host: 127.3.6.20
I20260928 13:04:51.585286  3096 mini_ranger.cc:227] Ranger admin URL: http://127.3.6.20:34833
Sep 28, 2026 1:04:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 1:04:51 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 1:04:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp
Sep 28, 2026 1:04:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 28, 2026 1:04:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 28, 2026 1:04:52 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-admin/ews/webapp].
Sep 28, 2026 1:04:52 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260928 13:04:52.713169  3096 mini_ranger.cc:160] Time spent starting Ranger: real 8.435s	user 0.000s	sys 0.008s
Sep 28, 2026 1:05:12 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
  org.apache.ranger.rest
  org.apache.ranger.common
  xa.rest
Sep 28, 2026 1:05:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
  class org.apache.ranger.rest.XAuditREST
  class org.apache.ranger.rest.TagREST
  class org.apache.ranger.rest.UserREST
  class org.apache.ranger.rest.RoleREST
  class org.apache.ranger.rest.MetricsREST
  class org.apache.ranger.rest.SecurityZoneREST
  class org.apache.ranger.rest.ServiceREST
  class org.apache.ranger.rest.AssetREST
  class org.apache.ranger.rest.PublicAPIsv2
  class org.apache.ranger.rest.PublicAPIs
  class org.apache.ranger.rest.XUserREST
  class org.apache.ranger.rest.XKeyREST
Sep 28, 2026 1:05:12 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
  class org.apache.ranger.common.RangerJAXBContextResolver
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 28, 2026 1:05:12 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 28, 2026 1:05:13 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
  WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260928 13:05:13.811102  3096 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.3.6.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.3.6.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangerkms_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.3.6.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/rangerkms_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.3.6.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.3.6.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.3.6.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/HTTP_127.3.6.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 28 13:05:13 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600713, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM: 
I20260928 13:05:13.899895  3096 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260928 13:05:13.908583  3096 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260928 13:05:14.757876  3096 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260928 13:05:14.757963  3096 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms
I20260928 13:05:14.757982  3096 mini_ranger_kms.cc:227] Using postgres at 127.3.6.20:53875
2026-09-28 13:05:14,923  [I] DB FLAVOR :POSTGRES
2026-09-28 13:05:14,923  [I] --------- Verifying Ranger DB connection ---------
2026-09-28 13:05:14,923  [I] Checking connection
2026-09-28 13:05:14,923  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-28 13:05:15,178  [I] connection success
2026-09-28 13:05:15,178  [I] --------- Verifying Ranger DB tables ---------
2026-09-28 13:05:15,179  [I] Verifying table ranger_masterkey in database rangerkms
2026-09-28 13:05:15,179  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-28 13:05:15,428  [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-28 13:05:15,429  [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 13:05:15,429  [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-28 13:05:15,429  [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java  -cp /tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.3.6.20:53875/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-28 13:05:15,688  [I] kms_core_db_postgres.sql DB schema imported successfully
I20260928 13:05:16.196702  3096 mini_ranger_kms.cc:310] Created kms service
I20260928 13:05:16.388368  3096 mini_ranger_kms.cc:326] Created kudu user
I20260928 13:05:16.437000  3096 mini_ranger_kms.cc:343] Created rangerkms user
Sep 28 13:05:16 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600713, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:16.878334  3096 mini_ranger_kms.cc:384] Added ranger policy
I20260928 13:05:16.878455  3096 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms:/tmp/dist-test-tasktCerZp/build/release/bin/postgresql.jar:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasktCerZp/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260928 13:05:16.878475  3096 mini_ranger_kms.cc:240] Using host: 127.3.6.20
I20260928 13:05:16.881954  3096 mini_ranger_kms.cc:276] Ranger KMS PID: 15229
I20260928 13:05:16.882040  3096 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.3.6.20:44953
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-kms/ews/webapp].
Sep 28, 2026 1:05:18 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260928 13:05:19.206598  3096 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.307s	user 0.000s	sys 0.148s
I20260928 13:05:19.206699  3096 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260928 13:05:19.206753  3096 mini_ranger_kms.cc:401] 127.3.6.20:44953/kms/v1/keys
Sep 28 13:05:19 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790600719, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 28 13:05:19 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600719, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
Sep 28 13:05:20 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600719, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.3.6.20@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
Sep 28 13:05:22 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:05:22.477679  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36845
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36845
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:22.558614 15280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:22.558840 15280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:22.558877 15280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:22.560078 15280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:22.560148 15280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:22.560171 15280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:22.560200 15280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:22.560237 15280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:22.561784 15280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
--ranger_kms_url=127.3.6.20:44953/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36845
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:22.562043 15280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:22.562314 15280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:22.567241 15286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:22.567226 15285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:22.567222 15288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:22.567566 15280 server_base.cc:1034] running on GCE node
I20260928 13:05:22.567857 15280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:22.568202 15280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:22.569396 15280 hybrid_clock.cc:648] HybridClock initialized: now 1790600722569377 us; error 37 us; skew 500 ppm
Sep 28 13:05:22 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600722, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:22.572449 15280 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:22.572988 15280 webserver.cc:460] Webserver started at http://127.3.6.62:41305/ using document root <none> and password file <none>
I20260928 13:05:22.573242 15280 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:22.573309 15280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:22.573619 15280 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:05:22 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600722, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:22.634066 15280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "e9fa6544ccd3493cac8444262e8301b5"
format_stamp: "Formatted at 2026-09-28 13:05:22 on dist-test-slave-ddvw"
server_key: "7282938f9ba8311b89288fb36eb92490"
server_key_iv: "20c694c4a2485acaf5ce22362bca4b91"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:22.634416 15280 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "e9fa6544ccd3493cac8444262e8301b5"
format_stamp: "Formatted at 2026-09-28 13:05:22 on dist-test-slave-ddvw"
server_key: "7282938f9ba8311b89288fb36eb92490"
server_key_iv: "20c694c4a2485acaf5ce22362bca4b91"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:22.635872 15280 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:05:22.650067 15295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:22.650295 15280 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:22.650405 15280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "e9fa6544ccd3493cac8444262e8301b5"
format_stamp: "Formatted at 2026-09-28 13:05:22 on dist-test-slave-ddvw"
server_key: "7282938f9ba8311b89288fb36eb92490"
server_key_iv: "20c694c4a2485acaf5ce22362bca4b91"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:22.650511 15280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:22.669941 15280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:22.672112 15280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:22.672266 15280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:22.677160 15280 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36845
I20260928 13:05:22.677234 15347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36845 every 8 connection(s)
I20260928 13:05:22.677597 15280 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:22.678340 15348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:22.681313 15348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Bootstrap starting.
I20260928 13:05:22.681995 15348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:22.682296 15348 log.cc:824] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:22.683048 15348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: No bootstrap required, opened a new log
I20260928 13:05:22.683766  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15280
I20260928 13:05:22.683971  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:05:22.684160  3096 external_mini_cluster.cc:1428] Setting key 58a8b9a5b1821b31a302a59944930eba
I20260928 13:05:22.685736 15348 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:22.685938 15348 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:22.686002 15348 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fa6544ccd3493cac8444262e8301b5, State: Initialized, Role: FOLLOWER
I20260928 13:05:22.686131 15348 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:22.686200 15348 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:22.686226 15348 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:22.686285 15348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:22.686916 15348 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:22.687037 15348 leader_election.cc:302] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9fa6544ccd3493cac8444262e8301b5; no voters: 
I20260928 13:05:22.687227 15348 leader_election.cc:288] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:05:22.687278 15353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:22.687492 15353 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 LEADER]: Becoming Leader. State: Replica: e9fa6544ccd3493cac8444262e8301b5, State: Running, Role: LEADER
I20260928 13:05:22.687526 15348 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:22.687630 15353 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:22.687906 15353 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9fa6544ccd3493cac8444262e8301b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } } }
I20260928 13:05:22.687954 15353 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:22.688047 15353 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9fa6544ccd3493cac8444262e8301b5. Latest consensus state: current_term: 1 leader_uuid: "e9fa6544ccd3493cac8444262e8301b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } } }
I20260928 13:05:22.688078 15353 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:22.688170 15359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:22.688653 15359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:22.689054 15348 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260928 13:05:22.694465 15359 catalog_manager.cc:1347] Generated new cluster ID: 22345566337341a1ae25f966cf3e424e
I20260928 13:05:22.694614 15359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:05:22 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:22.699394 15352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:22.684685 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60364 (local address 127.3.6.62:36845)
0928 13:05:22.684900 (+   215us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:22.684909 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:22.684946 (+    37us) server_negotiation.cc:407] Connection header received
0928 13:05:22.685714 (+   768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:22.685721 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:22.685766 (+    45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:22.685921 (+   155us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:22.686757 (+   836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:22.688199 (+  1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:22.689321 (+  1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:22.692265 (+  2944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:22.692728 (+   463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:22.695571 (+  2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:22.695575 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:22.695575 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:22.695585 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:22.697487 (+  1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:22.697856 (+   369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:22.697859 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:22.697859 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:22.697982 (+   123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:22.698197 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:22.698197 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:22.698198 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:22.698498 (+   300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:22.698980 (+   482us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:22.699077 (+    97us) server_negotiation.cc:299] Negotiation successful
0928 13:05:22.699195 (+   118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":94,"threads_started":1}
I20260928 13:05:22.705873 15359 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:05:22.706651 15359 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:22.710369 15359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Generated new TSK 0
I20260928 13:05:22.710619 15359 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:05:23.474589  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:23.585570 15393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:23.585803 15393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:23.585843 15393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:23.587173 15393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:23.587236 15393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:23.587280 15393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:23.589066 15393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:23.589329 15393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:23.589614 15393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:23.594583 15399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:23.594583 15398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:23.594853 15401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:23.595556 15393 server_base.cc:1034] running on GCE node
I20260928 13:05:23.595824 15393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:23.596095 15393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:23.597246 15393 hybrid_clock.cc:648] HybridClock initialized: now 1790600723597229 us; error 30 us; skew 500 ppm
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:23.600033 15393 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:23.600474 15393 webserver.cc:460] Webserver started at http://127.3.6.1:39037/ using document root <none> and password file <none>
I20260928 13:05:23.600728 15393 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:23.600796 15393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:23.600952 15393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:23.613076 15393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "047c27194a3f4a7cbffd17089ea98956"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "db700af8ebfb468a5f25bb06e534b746"
server_key_iv: "9f4b2adb67f8a2bea791b1bd11335716"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.613657 15393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "047c27194a3f4a7cbffd17089ea98956"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "db700af8ebfb468a5f25bb06e534b746"
server_key_iv: "9f4b2adb67f8a2bea791b1bd11335716"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.615614 15393 fs_manager.cc:691] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.001s
I20260928 13:05:23.628620 15409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.628888 15393 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:23.629014 15393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "047c27194a3f4a7cbffd17089ea98956"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "db700af8ebfb468a5f25bb06e534b746"
server_key_iv: "9f4b2adb67f8a2bea791b1bd11335716"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.629115 15393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:23.655499 15393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:23.658082 15393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:23.658303 15393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:23.658605 15393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:23.659132 15393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:23.659227 15393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.659334 15393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:23.659415 15393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.666009 15393 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:35601
I20260928 13:05:23.666515 15393 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:23.668771 15523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:35601 every 8 connection(s)
I20260928 13:05:23.671224  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15393
I20260928 13:05:23.671314  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:05:23.671518  3096 external_mini_cluster.cc:1428] Setting key f15a20d2c1d16ca0750f912ccf1e9d6c
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:23.680243 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:23.669404 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:42599 (local address 127.3.6.62:36845)
0928 13:05:23.669891 (+   487us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:23.669894 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:23.669906 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:05:23.670447 (+   541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:23.670448 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:23.670463 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:23.670555 (+    92us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:23.671331 (+   776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.672199 (+   868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.673625 (+  1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.673952 (+   327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.674021 (+    69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:23.676618 (+  2597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:23.676619 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:23.676620 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:23.676627 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:23.678608 (+  1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:23.679124 (+   516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:23.679125 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:23.679125 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:23.679192 (+    67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:23.679476 (+   284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:23.679477 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:23.679477 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:23.679613 (+   136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:23.679668 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:23.680056 (+   388us) server_negotiation.cc:299] Negotiation successful
0928 13:05:23.680145 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":81,"threads_started":1}
I20260928 13:05:23.680843 15526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:23.669359 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.1:42599)
0928 13:05:23.669568 (+   209us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:23.669626 (+    58us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:23.670311 (+   685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:23.670644 (+   333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:23.670649 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:23.670928 (+   279us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:23.671218 (+   290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:23.671224 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.672309 (+  1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.672310 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:23.673527 (+  1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:23.673530 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.674036 (+   506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.674048 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:23.674200 (+   152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:23.674814 (+   614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:23.674824 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:23.676502 (+  1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:23.678702 (+  2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:23.678708 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:23.678710 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:23.679035 (+   325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:23.679267 (+   232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:23.679268 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:23.679268 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:23.679399 (+   131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:23.679703 (+   304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:23.679709 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:23.679894 (+   185us) client_negotiation.cc:769] Sending connection context
0928 13:05:23.680448 (+   554us) client_negotiation.cc:240] Negotiation successful
0928 13:05:23.680613 (+   165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":83,"threads_started":1}
I20260928 13:05:23.681413 15524 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:23.681540 15524 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:23.681752 15524 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
I20260928 13:05:23.682287 15312 ts_manager.cc:194] Registered new tserver with Master: 047c27194a3f4a7cbffd17089ea98956 (127.3.6.1:35601)
I20260928 13:05:23.683252 15312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:42599
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:05:23.714275  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:23.847935 15530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:23.848310 15530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:23.848395 15530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:23.850236 15530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:23.850363 15530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:23.850451 15530 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:23.852757 15530 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:23.853318 15530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:23.853652 15530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:23.860572 15538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:23.861354 15537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:23.861874 15530 server_base.cc:1034] running on GCE node
W20260928 13:05:23.867209 15540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:23.867677 15530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:23.867998 15530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:23.869176 15530 hybrid_clock.cc:648] HybridClock initialized: now 1790600723869162 us; error 45 us; skew 500 ppm
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:23.872570 15530 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:23.873114 15530 webserver.cc:460] Webserver started at http://127.3.6.2:35803/ using document root <none> and password file <none>
I20260928 13:05:23.873379 15530 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:23.873432 15530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:23.873560 15530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:23.889532 15530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "85d7d6b6528c40e595831e10229a53cd"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "f6b6b5c668ebcd76f4104ffb5071a2e3"
server_key_iv: "1fa2613cd77d8e6a92d31d9d74bd33f1"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.891326 15530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "85d7d6b6528c40e595831e10229a53cd"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "f6b6b5c668ebcd76f4104ffb5071a2e3"
server_key_iv: "1fa2613cd77d8e6a92d31d9d74bd33f1"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.894563 15530 fs_manager.cc:691] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.000s
I20260928 13:05:23.907310 15547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.907557 15530 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:05:23.907637 15530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "85d7d6b6528c40e595831e10229a53cd"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "f6b6b5c668ebcd76f4104ffb5071a2e3"
server_key_iv: "1fa2613cd77d8e6a92d31d9d74bd33f1"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:23.907717 15530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:23.941818 15530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:23.944345 15530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:23.944491 15530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:23.944707 15530 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:23.945101 15530 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:23.945144 15530 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.945174 15530 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:23.945240 15530 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:23.952378 15530 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44741
I20260928 13:05:23.952801 15530 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:23.953141 15660 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44741 every 8 connection(s)
I20260928 13:05:23.955762  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15530
I20260928 13:05:23.955864  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:05:23.956050  3096 external_mini_cluster.cc:1428] Setting key dc9c9fec42c1e75cde3a65d17a5b88c9
Sep 28 13:05:23 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600723, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:23.964198 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:23.953894 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:46043 (local address 127.3.6.62:36845)
0928 13:05:23.953958 (+    64us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:23.953961 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:23.954242 (+   281us) server_negotiation.cc:407] Connection header received
0928 13:05:23.954879 (+   637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:23.954881 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:23.954893 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:23.954986 (+    93us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:23.955720 (+   734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.956458 (+   738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.957839 (+  1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.958137 (+   298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.958181 (+    44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:23.960803 (+  2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:23.960805 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:23.960805 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:23.960813 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:23.962525 (+  1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:23.963051 (+   526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:23.963053 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:23.963053 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:23.963116 (+    63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:23.963433 (+   317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:23.963434 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:23.963434 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:23.963575 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:23.963644 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:23.964010 (+   366us) server_negotiation.cc:299] Negotiation successful
0928 13:05:23.964103 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260928 13:05:23.964377 15663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:23.953606 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.2:46043)
0928 13:05:23.954108 (+   502us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:23.954151 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:23.954754 (+   603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:23.955089 (+   335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:23.955093 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:23.955339 (+   246us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:23.955607 (+   268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:23.955613 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.956567 (+   954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.956568 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:23.957739 (+  1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:23.957742 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:23.958294 (+   552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:23.958305 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:23.958442 (+   137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:23.959071 (+   629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:23.959082 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:23.960687 (+  1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:23.962617 (+  1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:23.962623 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:23.962626 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:23.962930 (+   304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:23.963193 (+   263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:23.963194 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:23.963194 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:23.963346 (+   152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:23.963657 (+   311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:23.963664 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:23.963845 (+   181us) client_negotiation.cc:769] Sending connection context
0928 13:05:23.963970 (+   125us) client_negotiation.cc:240] Negotiation successful
0928 13:05:23.964131 (+   161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":82,"threads_started":1}
I20260928 13:05:23.965018 15661 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:23.965126 15661 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:23.965361 15661 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:23.965749 15312 ts_manager.cc:194] Registered new tserver with Master: 85d7d6b6528c40e595831e10229a53cd (127.3.6.2:44741)
I20260928 13:05:23.966267 15312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:46043
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:05:24.006270  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:24.130575 15667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:24.130939 15667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:24.131057 15667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:24.132973 15667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:24.133091 15667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:24.133184 15667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:24.135480 15667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:24.135980 15667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:24.136420 15667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:24.143440 15672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.143613 15673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.144512 15675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:24.144673 15667 server_base.cc:1034] running on GCE node
I20260928 13:05:24.144893 15667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:24.145185 15667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:24.146353 15667 hybrid_clock.cc:648] HybridClock initialized: now 1790600724146327 us; error 41 us; skew 500 ppm
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:24.149725 15667 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:24.150246 15667 webserver.cc:460] Webserver started at http://127.3.6.3:46319/ using document root <none> and password file <none>
I20260928 13:05:24.150482 15667 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:24.150529 15667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:24.150648 15667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:24.163918 15667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "cf132a56325a48a2ba93b0085bde7fdf"
format_stamp: "Formatted at 2026-09-28 13:05:24 on dist-test-slave-ddvw"
server_key: "392f53199ed0f975bc97394f6ea5c405"
server_key_iv: "3a6b21f07b2f55b8d924cdeff14f0cc4"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.164348 15667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "cf132a56325a48a2ba93b0085bde7fdf"
format_stamp: "Formatted at 2026-09-28 13:05:24 on dist-test-slave-ddvw"
server_key: "392f53199ed0f975bc97394f6ea5c405"
server_key_iv: "3a6b21f07b2f55b8d924cdeff14f0cc4"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.169394 15667 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.000s
I20260928 13:05:24.182019 15682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.182266 15667 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:05:24.182358 15667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "cf132a56325a48a2ba93b0085bde7fdf"
format_stamp: "Formatted at 2026-09-28 13:05:24 on dist-test-slave-ddvw"
server_key: "392f53199ed0f975bc97394f6ea5c405"
server_key_iv: "3a6b21f07b2f55b8d924cdeff14f0cc4"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.182447 15667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:24.204129 15667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:24.206525 15667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:24.206715 15667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:24.207106 15667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:24.207515 15667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:24.207602 15667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.207679 15667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:24.207746 15667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.214596 15667 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45877
I20260928 13:05:24.215307 15667 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:24.218797  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15667
I20260928 13:05:24.218906  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:05:24.219151  3096 external_mini_cluster.cc:1428] Setting key 13057933b4fad35f96bd1365448fee2f
I20260928 13:05:24.217859 15795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45877 every 8 connection(s)
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:24.230077 15527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.218714 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:53179 (local address 127.3.6.62:36845)
0928 13:05:24.218775 (+    61us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:24.218779 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:24.219322 (+   543us) server_negotiation.cc:407] Connection header received
0928 13:05:24.220067 (+   745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:24.220068 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:24.220080 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:24.220110 (+    30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:24.220968 (+   858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.221704 (+   736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.223439 (+  1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.223748 (+   309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.223796 (+    48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.226589 (+  2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:24.226590 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:24.226591 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:24.226598 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:24.228448 (+  1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.228976 (+   528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.228978 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.228978 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.229037 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.229312 (+   275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.229313 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.229314 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.229445 (+   131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:24.229487 (+    42us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:24.229888 (+   401us) server_negotiation.cc:299] Negotiation successful
0928 13:05:24.229976 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:05:24.230844 15798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.218427 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.3:53179)
0928 13:05:24.219122 (+   695us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:24.219168 (+    46us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:24.219957 (+   789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:24.220296 (+   339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:24.220300 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:24.220550 (+   250us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:24.220850 (+   300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.220857 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.221939 (+  1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.221940 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.223342 (+  1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.223345 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.223893 (+   548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.223904 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.224041 (+   137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.224724 (+   683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:24.224755 (+    31us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:24.226452 (+  1697us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:24.228547 (+  2095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.228553 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.228556 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.228878 (+   322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.229108 (+   230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.229109 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.229109 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.229234 (+   125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.229534 (+   300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:24.229539 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:24.229710 (+   171us) client_negotiation.cc:769] Sending connection context
0928 13:05:24.230431 (+   721us) client_negotiation.cc:240] Negotiation successful
0928 13:05:24.230601 (+   170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":79,"threads_started":1}
I20260928 13:05:24.231724 15796 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:24.231829 15796 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.232012 15796 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:24.232373 15312 ts_manager.cc:194] Registered new tserver with Master: cf132a56325a48a2ba93b0085bde7fdf (127.3.6.3:45877)
I20260928 13:05:24.232848 15312 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:53179
I20260928 13:05:24.241428  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:05:24.242292  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15393
I20260928 13:05:24.247910  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15530
I20260928 13:05:24.253060  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15667
I20260928 13:05:24.258080  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15280
I20260928 13:05:24.263408  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36845
--webserver_interface=127.3.6.62
--webserver_port=41305
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36845
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:24.342693 15799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:24.342900 15799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:24.342921 15799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:24.344013 15799 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:24.344049 15799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:24.344064 15799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:24.344076 15799 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:24.344089 15799 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:24.345551 15799 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36845
--ranger_config_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=41305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:24.345721 15799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:24.345883 15799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:24.350646 15805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.350634 15807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.350620 15804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:24.350818 15799 server_base.cc:1034] running on GCE node
I20260928 13:05:24.351155 15799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:24.351433 15799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:24.352577 15799 hybrid_clock.cc:648] HybridClock initialized: now 1790600724352561 us; error 36 us; skew 500 ppm
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:24.355070 15799 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:24.355525 15799 webserver.cc:460] Webserver started at http://127.3.6.62:41305/ using document root <none> and password file <none>
I20260928 13:05:24.355711 15799 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:24.355762 15799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:24.420244 15799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:24.421185 15815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.421378 15799 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:24.421490 15799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "e9fa6544ccd3493cac8444262e8301b5"
format_stamp: "Formatted at 2026-09-28 13:05:22 on dist-test-slave-ddvw"
server_key: "7282938f9ba8311b89288fb36eb92490"
server_key_iv: "20c694c4a2485acaf5ce22362bca4b91"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.421957 15799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:24.445292 15799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:24.447482 15799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:24.447598 15799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:24.451887 15799 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36845
I20260928 13:05:24.451969 15867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36845 every 8 connection(s)
I20260928 13:05:24.452316 15799 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:24.453599 15868 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:05:24.454222 15868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Bootstrap starting.
I20260928 13:05:24.459151  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15799
I20260928 13:05:24.459491  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:35601
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:36845
--webserver_port=39037
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:24.462874 15868 log.cc:824] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:24.465118 15868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:05:24.465456 15868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Bootstrap complete.
I20260928 13:05:24.469142 15868 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:24.469493 15868 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9fa6544ccd3493cac8444262e8301b5, State: Initialized, Role: FOLLOWER
I20260928 13:05:24.469728 15868 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:24.469811 15868 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:24.469857 15868 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:24.469938 15868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:05:24.471467 15868 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:24.471622 15868 leader_election.cc:302] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9fa6544ccd3493cac8444262e8301b5; no voters: 
I20260928 13:05:24.471827 15868 leader_election.cc:288] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260928 13:05:24.471863 15872 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 13:05:24.471995 15872 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [term 2 LEADER]: Becoming Leader. State: Replica: e9fa6544ccd3493cac8444262e8301b5, State: Running, Role: LEADER
I20260928 13:05:24.472090 15872 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } }
I20260928 13:05:24.472260 15868 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:24.472335 15872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9fa6544ccd3493cac8444262e8301b5. Latest consensus state: current_term: 2 leader_uuid: "e9fa6544ccd3493cac8444262e8301b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } } }
I20260928 13:05:24.472394 15872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:24.472362 15874 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "e9fa6544ccd3493cac8444262e8301b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9fa6544ccd3493cac8444262e8301b5" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36845 } } }
I20260928 13:05:24.472477 15874 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:24.474035 15868 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260928 13:05:24.476938 15876 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:24.477910 15876 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:24.478108 15876 catalog_manager.cc:1259] Loaded cluster ID: 22345566337341a1ae25f966cf3e424e
I20260928 13:05:24.478206 15876 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:05:24.479712 15876 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:24.479964 15876 catalog_manager.cc:5879] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Loaded TSK: 0
I20260928 13:05:24.480249 15876 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 13:05:24.570425 15870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:24.570662 15870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:24.570704 15870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:24.571980 15870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:24.572048 15870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:24.572098 15870 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:24.573899 15870 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:35601
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=39037
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:24.574158 15870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:24.574417 15870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:24.581950 15908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.582261 15905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.582686 15906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:24.584308 15870 server_base.cc:1034] running on GCE node
I20260928 13:05:24.584538 15870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:24.584826 15870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:24.586027 15870 hybrid_clock.cc:648] HybridClock initialized: now 1790600724586005 us; error 32 us; skew 500 ppm
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:24.589349 15870 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:24.589910 15870 webserver.cc:460] Webserver started at http://127.3.6.1:39037/ using document root <none> and password file <none>
I20260928 13:05:24.590220 15870 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:24.590312 15870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:24.605587 15870 fs_manager.cc:709] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.001s
I20260928 13:05:24.606626 15916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.606825 15870 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:24.606905 15870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "047c27194a3f4a7cbffd17089ea98956"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "db700af8ebfb468a5f25bb06e534b746"
server_key_iv: "9f4b2adb67f8a2bea791b1bd11335716"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.607419 15870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:24.640005 15870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:24.642252 15870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:24.642418 15870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:24.642670 15870 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:24.643105 15870 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:24.643144 15870 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.643168 15870 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:24.643186 15870 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.650633 15870 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:35601
I20260928 13:05:24.650729 16029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:35601 every 8 connection(s)
I20260928 13:05:24.651116 15870 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:24.656632  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 15870
I20260928 13:05:24.656925  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:44741
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:36845
--webserver_port=35803
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:24.665934 16033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.652011 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:38445 (local address 127.3.6.62:36845)
0928 13:05:24.652828 (+   817us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:24.652834 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:24.652860 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:05:24.652970 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:24.652974 (+     4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:24.653012 (+    38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:24.653107 (+    95us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:24.653862 (+   755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.654711 (+   849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.656236 (+  1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.656651 (+   415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.656781 (+   130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.659109 (+  2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:24.659114 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:24.659114 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:24.659126 (+    12us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:24.661288 (+  2162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.661832 (+   544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.661835 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.661836 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.661942 (+   106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.662232 (+   290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.662233 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.662233 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.662551 (+   318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:24.665238 (+  2687us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:24.665598 (+   360us) server_negotiation.cc:299] Negotiation successful
0928 13:05:24.665714 (+   116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":766,"thread_start_us":96,"threads_started":1}
I20260928 13:05:24.665947 16032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.651926 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.1:38445)
0928 13:05:24.652150 (+   224us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:24.652197 (+    47us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:24.652662 (+   465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:24.653215 (+   553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:24.653219 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:24.653458 (+   239us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:24.653732 (+   274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.653738 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.654828 (+  1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.654829 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.656132 (+  1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.656134 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.656738 (+   604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.656767 (+    29us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.656932 (+   165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.657552 (+   620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:24.657562 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:24.658949 (+  1387us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:24.661397 (+  2448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.661403 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.661405 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.661706 (+   301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.662023 (+   317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.662025 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.662025 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.662150 (+   125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.665212 (+  3062us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:24.665218 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:24.665392 (+   174us) client_negotiation.cc:769] Sending connection context
0928 13:05:24.665540 (+   148us) client_negotiation.cc:240] Negotiation successful
0928 13:05:24.665714 (+   174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":143,"threads_started":1}
I20260928 13:05:24.666951 16030 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:24.667151 16030 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.667426 16030 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:24.668270 16030 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36845 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 13:05:24.668437 16030 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.668551 16030 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:24.668905 16030 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.669031 16030 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:24.669342 16030 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:05:24.780433 16034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:24.780716 16034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:24.780752 16034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:24.782493 16034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:24.782563 16034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:24.782605 16034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:24.785024 16034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:44741
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=35803
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:24.785272 16034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:24.785590 16034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:24.791698 16039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.791785 16040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.791865 16042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:24.793964 16034 server_base.cc:1034] running on GCE node
I20260928 13:05:24.794221 16034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:24.794590 16034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:24.795852 16034 hybrid_clock.cc:648] HybridClock initialized: now 1790600724795803 us; error 62 us; skew 500 ppm
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:24.799392 16034 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:24.799880 16034 webserver.cc:460] Webserver started at http://127.3.6.2:35803/ using document root <none> and password file <none>
I20260928 13:05:24.800124 16034 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:24.800225 16034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:24.817726 16034 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:24.819140 16050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.819303 16034 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:24.819394 16034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "85d7d6b6528c40e595831e10229a53cd"
format_stamp: "Formatted at 2026-09-28 13:05:23 on dist-test-slave-ddvw"
server_key: "f6b6b5c668ebcd76f4104ffb5071a2e3"
server_key_iv: "1fa2613cd77d8e6a92d31d9d74bd33f1"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.819834 16034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:24.830415 16034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:24.833171 16034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:24.833349 16034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:24.833608 16034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:24.833962 16034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:24.834026 16034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.834085 16034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:24.834115 16034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.839421 16034 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44741
I20260928 13:05:24.839572 16163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44741 every 8 connection(s)
I20260928 13:05:24.839919 16034 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:24.845165  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16034
I20260928 13:05:24.845471  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.3.6.20:44953/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:45877
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:36845
--webserver_port=46319
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:24.851943 16033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.840987 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:53655 (local address 127.3.6.62:36845)
0928 13:05:24.841068 (+    81us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:24.841070 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:24.841344 (+   274us) server_negotiation.cc:407] Connection header received
0928 13:05:24.842047 (+   703us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:24.842048 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:24.842058 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:24.842103 (+    45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:24.842892 (+   789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.843458 (+   566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.845103 (+  1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.845431 (+   328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.845506 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.848069 (+  2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:24.848071 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:24.848071 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:24.848080 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:24.850044 (+  1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.850609 (+   565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.850610 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.850611 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.850676 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:24.851003 (+   327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:24.851005 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:24.851031 (+    26us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:24.851202 (+   171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:24.851304 (+   102us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:24.851704 (+   400us) server_negotiation.cc:299] Negotiation successful
0928 13:05:24.851808 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260928 13:05:24.852139 16166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:24.840946 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.2:53655)
0928 13:05:24.841166 (+   220us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:24.841219 (+    53us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:24.841929 (+   710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:24.842200 (+   271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:24.842204 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:24.842461 (+   257us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:24.842794 (+   333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.842802 (+     8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.843566 (+   764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.843567 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.844990 (+  1423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:24.844993 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:24.845568 (+   575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:24.845598 (+    30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:24.845738 (+   140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:24.846345 (+   607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:24.846356 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:24.847951 (+  1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:24.850144 (+  2193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.850151 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.850154 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.850509 (+   355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.850758 (+   249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:24.850759 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:24.850760 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:24.850907 (+   147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:24.851305 (+   398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:24.851321 (+    16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:24.851514 (+   193us) client_negotiation.cc:769] Sending connection context
0928 13:05:24.851649 (+   135us) client_negotiation.cc:240] Negotiation successful
0928 13:05:24.851830 (+   181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":117,"threads_started":1}
I20260928 13:05:24.853065 16164 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:24.853185 16164 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.853415 16164 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:24.854218 16164 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36845 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 13:05:24.854298 16164 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.854364 16164 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:24.854774 16164 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:24.854852 16164 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:24.855240 16164 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:05:24.949290 16167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:24.949546 16167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:24.949587 16167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:24.951228 16167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:24.951300 16167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:24.951346 16167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:24.952934 16167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.3.6.20:44953/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:45877
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=46319
--tserver_master_addrs=127.3.6.62:36845
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:24.953187 16167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:24.953421 16167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:24.958330 16175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.958379 16172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:24.959292 16173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:24.959458 16167 server_base.cc:1034] running on GCE node
I20260928 13:05:24.959654 16167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:24.959957 16167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:24.961115 16167 hybrid_clock.cc:648] HybridClock initialized: now 1790600724961096 us; error 35 us; skew 500 ppm
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:24.963766 16167 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:24.964264 16167 webserver.cc:460] Webserver started at http://127.3.6.3:46319/ using document root <none> and password file <none>
I20260928 13:05:24.964510 16167 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:24.964591 16167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 13:05:24 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:24.982111 16167 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:24.984648 16184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:24.984886 16167 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:05:24.984966 16167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "cf132a56325a48a2ba93b0085bde7fdf"
format_stamp: "Formatted at 2026-09-28 13:05:24 on dist-test-slave-ddvw"
server_key: "392f53199ed0f975bc97394f6ea5c405"
server_key_iv: "3a6b21f07b2f55b8d924cdeff14f0cc4"
server_key_version: "kuduclusterkey@0"
I20260928 13:05:24.985419 16167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:25.009042 16167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:25.011474 16167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:25.011639 16167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:25.011895 16167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:25.012275 16167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:25.012323 16167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:25.012392 16167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:25.012421 16167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:25.019582 16167 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45877
I20260928 13:05:25.019651 16297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45877 every 8 connection(s)
I20260928 13:05:25.019979 16167 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:25.023190  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16167
Sep 28 13:05:25 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600724, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:25.031714 16033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:25.020770 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:35987 (local address 127.3.6.62:36845)
0928 13:05:25.020824 (+    54us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:25.020826 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:25.021141 (+   315us) server_negotiation.cc:407] Connection header received
0928 13:05:25.021824 (+   683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:25.021826 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:25.021839 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:25.021871 (+    32us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:25.022733 (+   862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.023524 (+   791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.025342 (+  1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.025638 (+   296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.025684 (+    46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:25.028280 (+  2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:25.028281 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:25.028282 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:25.028288 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:25.030138 (+  1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:25.030671 (+   533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:25.030672 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:25.030673 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:25.030758 (+    85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:25.031072 (+   314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:25.031074 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:25.031074 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:25.031189 (+   115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:25.031267 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:25.031540 (+   273us) server_negotiation.cc:299] Negotiation successful
0928 13:05:25.031621 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:05:25.031929 16300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:25.020760 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36845 (local address 127.3.6.3:35987)
0928 13:05:25.021013 (+   253us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:25.021055 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:25.021687 (+   632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:25.022129 (+   442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:25.022134 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:25.022356 (+   222us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:25.022623 (+   267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:25.022630 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.023972 (+  1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.023973 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:25.025237 (+  1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:25.025240 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.025764 (+   524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.025788 (+    24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:25.025935 (+   147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:25.026503 (+   568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:25.026514 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:25.028182 (+  1668us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:25.030215 (+  2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:25.030221 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:25.030224 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:25.030593 (+   369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:25.030812 (+   219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:25.030857 (+    45us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:25.030857 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:25.030969 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:25.031259 (+   290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:25.031265 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:25.031409 (+   144us) client_negotiation.cc:769] Sending connection context
0928 13:05:25.031522 (+   113us) client_negotiation.cc:240] Negotiation successful
0928 13:05:25.031669 (+   147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":91,"threads_started":1}
I20260928 13:05:25.032487 16298 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36845
I20260928 13:05:25.032584 16298 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:25.032780 16298 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:25.033552 16298 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:36845 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 13:05:25.033665 16298 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:25.033766 16298 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:25.034119 16298 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:25.034221 16298 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
W20260928 13:05:25.034533 16298 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 13:05:25.035398 16301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:25.023770 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.3.6.62:36845)
0928 13:05:25.026386 (+  2616us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:25.026389 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:25.026395 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:05:25.026415 (+    20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:25.026416 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:25.027178 (+   762us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:25.027995 (+   817us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:25.028028 (+    33us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.028801 (+   773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.029946 (+  1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:25.030276 (+   330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:25.030593 (+   317us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:25.032180 (+  1587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:25.032181 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:25.032182 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:25.032188 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:25.034221 (+  2033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:25.034593 (+   372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:25.034594 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:25.034594 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:25.034652 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:25.034888 (+   236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:25.034889 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:25.034889 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:25.035029 (+   140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:25.035186 (+   157us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:25.035268 (+    82us) server_negotiation.cc:299] Negotiation successful
0928 13:05:25.035335 (+    67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2591,"thread_start_us":66,"threads_started":1}
Sep 28 13:05:25 dist-test-slave-ddvw krb5kdc[14836](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790600725, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:25.669577 16030 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:25.669751 16030 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:25.670136 15832 ts_manager.cc:194] Registered new tserver with Master: 047c27194a3f4a7cbffd17089ea98956 (127.3.6.1:35601)
I20260928 13:05:25.670850 15832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:38445
I20260928 13:05:25.855430 16164 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:25.855592 16164 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:25.855911 15832 ts_manager.cc:194] Registered new tserver with Master: 85d7d6b6528c40e595831e10229a53cd (127.3.6.2:44741)
I20260928 13:05:25.856467 15832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:53655
Sep 28 13:05:25 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600725, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:26.034787 16298 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:26.034962 16298 heartbeater.cc:511] Master 127.3.6.62:36845 requested a full tablet report, sending...
I20260928 13:05:26.035460 15832 ts_manager.cc:194] Registered new tserver with Master: cf132a56325a48a2ba93b0085bde7fdf (127.3.6.3:45877)
I20260928 13:05:26.036008 15832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:35987
I20260928 13:05:26.037642  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:05:26.046468 16319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.038630 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53224 (local address 127.3.6.62:36845)
0928 13:05:26.038882 (+   252us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.038884 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.039087 (+   203us) server_negotiation.cc:407] Connection header received
0928 13:05:26.039112 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.039113 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.039125 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.039185 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:26.039910 (+   725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.040689 (+   779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.041603 (+   914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.041866 (+   263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.041923 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.043404 (+  1481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:26.043405 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:26.043405 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:26.043412 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:26.045053 (+  1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:26.045415 (+   362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:26.045416 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:26.045416 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:26.045484 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:26.045665 (+   181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:26.045666 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:26.045666 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:26.045781 (+   115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:26.045863 (+    82us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.046283 (+   420us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.046360 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":62,"threads_started":1}
I20260928 13:05:26.048830 15832 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53224:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:05:26.051072 15832 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:05:26.063773 16325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057059 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:35601 (local address 127.0.0.1:59238)
0928 13:05:26.059135 (+  2076us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.059182 (+    47us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:26.059251 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:26.059637 (+   386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:26.059641 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:26.059643 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:26.059727 (+    84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.059729 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.061050 (+  1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.061051 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.062382 (+  1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.062386 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.063453 (+  1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.063454 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.063543 (+    89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.063557 (+    14us) client_negotiation.cc:769] Sending connection context
0928 13:05:26.063625 (+    68us) client_negotiation.cc:240] Negotiation successful
0928 13:05:26.063686 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2042,"thread_start_us":81,"threads_started":1}
I20260928 13:05:26.064361 16329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057758 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.3.6.1:35601)
0928 13:05:26.059399 (+  1641us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.059405 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.059415 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:05:26.059451 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.059453 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.059469 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.059547 (+    78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:26.059804 (+   257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.060954 (+  1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.062481 (+  1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.063287 (+   806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.063357 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.063415 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.064240 (+   825us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.064284 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1606,"thread_start_us":58,"threads_started":1}
I20260928 13:05:26.065244 15964 tablet_service.cc:1467] Processing CreateTablet for tablet 125eb815787747228ff69a2b593a0433 (DEFAULT_TABLE table=test-table [id=dd476d0183c8491199ccabed32b5619e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:26.065621 15964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125eb815787747228ff69a2b593a0433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:26.072355 16326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057288 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45877 (local address 127.0.0.1:36974)
0928 13:05:26.063086 (+  5798us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.063098 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:26.063154 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:26.063606 (+   452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:26.063607 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:26.063609 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:26.064161 (+   552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.064164 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.069901 (+  5737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.069902 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.071065 (+  1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.071067 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.072103 (+  1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.072104 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.072169 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.072173 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:26.072223 (+    50us) client_negotiation.cc:240] Negotiation successful
0928 13:05:26.072263 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5771,"mutex_wait_us":494,"thread_start_us":76,"threads_started":1}
I20260928 13:05:26.072813 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057401 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36974 (local address 127.3.6.3:45877)
0928 13:05:26.063376 (+  5975us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.063381 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.063392 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:05:26.063425 (+    33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.063427 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.063443 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.063512 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:26.064258 (+   746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.069796 (+  5538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.071161 (+  1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.071939 (+   778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.072012 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.072069 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.072675 (+   606us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.072721 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5938,"thread_start_us":55,"threads_started":1}
I20260928 13:05:26.073637 16232 tablet_service.cc:1467] Processing CreateTablet for tablet 125eb815787747228ff69a2b593a0433 (DEFAULT_TABLE table=test-table [id=dd476d0183c8491199ccabed32b5619e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:26.074025 16232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125eb815787747228ff69a2b593a0433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:26.074401 16331 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Bootstrap starting.
I20260928 13:05:26.074419 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057477 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44741 (local address 127.0.0.1:36268)
0928 13:05:26.063228 (+  5751us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.063236 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:26.063269 (+    33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:26.069752 (+  6483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:26.069753 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:26.069756 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:26.069812 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.069813 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.071122 (+  1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.071123 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.072561 (+  1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.072564 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.074166 (+  1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.074168 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.074248 (+    80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.074253 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:05:26.074285 (+    32us) client_negotiation.cc:240] Negotiation successful
0928 13:05:26.074331 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5740,"thread_start_us":73,"threads_started":1}
I20260928 13:05:26.074833 16330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.057909 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36268 (local address 127.3.6.2:44741)
0928 13:05:26.069506 (+ 11597us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.069512 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.069523 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:05:26.069559 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.069561 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.069578 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.069660 (+    82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:26.069893 (+   233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.071001 (+  1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.072740 (+  1739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.074053 (+  1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.074605 (+   552us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.074678 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.074705 (+    27us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.074751 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11556,"thread_start_us":61,"threads_started":1}
I20260928 13:05:26.075505 16098 tablet_service.cc:1467] Processing CreateTablet for tablet 125eb815787747228ff69a2b593a0433 (DEFAULT_TABLE table=test-table [id=dd476d0183c8491199ccabed32b5619e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:26.075820 16098 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125eb815787747228ff69a2b593a0433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:26.078259 16331 tablet_bootstrap.cc:654] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:26.078898 16333 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Bootstrap starting.
I20260928 13:05:26.079113 16331 log.cc:824] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:26.079155 16332 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Bootstrap starting.
I20260928 13:05:26.079664 16333 tablet_bootstrap.cc:654] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:26.079690 16332 tablet_bootstrap.cc:654] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:26.079916 16331 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: No bootstrap required, opened a new log
I20260928 13:05:26.079978 16332 log.cc:824] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:26.080003 16331 ts_tablet_manager.cc:1397] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.001s
I20260928 13:05:26.080840 16332 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: No bootstrap required, opened a new log
I20260928 13:05:26.080914 16332 ts_tablet_manager.cc:1397] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:05:26.082597 16331 raft_consensus.cc:348] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.082758 16331 raft_consensus.cc:374] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:26.082792 16331 raft_consensus.cc:729] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 047c27194a3f4a7cbffd17089ea98956, State: Initialized, Role: FOLLOWER
I20260928 13:05:26.082911 16331 consensus_queue.cc:260] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.083110 16333 log.cc:824] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:26.083200 16331 ts_tablet_manager.cc:1428] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.001s
I20260928 13:05:26.083331 16030 heartbeater.cc:503] Master 127.3.6.62:36845 was elected leader, sending a full tablet report...
I20260928 13:05:26.083349 16332 raft_consensus.cc:348] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.083508 16332 raft_consensus.cc:374] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:26.083539 16332 raft_consensus.cc:729] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf132a56325a48a2ba93b0085bde7fdf, State: Initialized, Role: FOLLOWER
I20260928 13:05:26.084329 16332 consensus_queue.cc:260] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.084653 16332 ts_tablet_manager.cc:1428] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260928 13:05:26.084954 16298 heartbeater.cc:503] Master 127.3.6.62:36845 was elected leader, sending a full tablet report...
I20260928 13:05:26.085222 16333 tablet_bootstrap.cc:492] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: No bootstrap required, opened a new log
I20260928 13:05:26.085283 16333 ts_tablet_manager.cc:1397] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Time spent bootstrapping tablet: real 0.006s	user 0.001s	sys 0.000s
I20260928 13:05:26.087690 16333 raft_consensus.cc:348] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.087836 16333 raft_consensus.cc:374] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:26.087880 16333 raft_consensus.cc:729] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85d7d6b6528c40e595831e10229a53cd, State: Initialized, Role: FOLLOWER
I20260928 13:05:26.088020 16333 consensus_queue.cc:260] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.088264 16333 ts_tablet_manager.cc:1428] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:05:26.088379 16164 heartbeater.cc:503] Master 127.3.6.62:36845 was elected leader, sending a full tablet report...
W20260928 13:05:26.091365 16165 tablet.cc:2369] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:05:26.152539 16031 tablet.cc:2369] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:05:26.196575 16336 raft_consensus.cc:482] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:26.196715 16336 raft_consensus.cc:504] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.197099 16336 leader_election.cc:288] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85d7d6b6528c40e595831e10229a53cd (127.3.6.2:44741), cf132a56325a48a2ba93b0085bde7fdf (127.3.6.3:45877)
I20260928 13:05:26.201509 16330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.197502 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:40933 (local address 127.3.6.2:44741)
0928 13:05:26.197552 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.197554 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.197849 (+   295us) server_negotiation.cc:407] Connection header received
0928 13:05:26.197938 (+    89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.197939 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.197951 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.198023 (+    72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:26.198291 (+   268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.198997 (+   706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.200604 (+  1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.201142 (+   538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.201188 (+    46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.201198 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.201404 (+   206us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.201441 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:05:26.201882 16327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.197750 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51571 (local address 127.3.6.3:45877)
0928 13:05:26.197792 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.197794 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.198005 (+   211us) server_negotiation.cc:407] Connection header received
0928 13:05:26.198101 (+    96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.198102 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.198113 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.198142 (+    29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:26.198347 (+   205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.199057 (+   710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.200869 (+  1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.201441 (+   572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.201490 (+    49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.201499 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.201764 (+   265us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.201814 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:05:26.202132 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.197581 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45877 (local address 127.3.6.1:51571)
0928 13:05:26.197955 (+   374us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.197963 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:26.198028 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:26.198203 (+   175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:26.198204 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:26.198205 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:26.198271 (+    66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.198273 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.199157 (+   884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.199158 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.200756 (+  1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.200758 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.201559 (+   801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.201560 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.201680 (+   120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.201684 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:26.201997 (+   313us) client_negotiation.cc:240] Negotiation successful
0928 13:05:26.202041 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":59,"thread_start_us":71,"threads_started":1}
I20260928 13:05:26.202495 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125eb815787747228ff69a2b593a0433" candidate_uuid: "047c27194a3f4a7cbffd17089ea98956" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf132a56325a48a2ba93b0085bde7fdf" is_pre_election: true
I20260928 13:05:26.202629 16340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.197299 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44741 (local address 127.3.6.1:40933)
0928 13:05:26.197783 (+   484us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.197796 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:26.197865 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:26.198126 (+   261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:26.198127 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:26.198130 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:26.198210 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.198212 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.199121 (+   909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.199122 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.200509 (+  1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:26.200511 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.201273 (+   762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.201274 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:26.201334 (+    60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.201338 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:26.201792 (+   454us) client_negotiation.cc:240] Negotiation successful
0928 13:05:26.201837 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":44,"thread_start_us":84,"threads_started":1}
I20260928 13:05:26.202674 16252 raft_consensus.cc:2454] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 047c27194a3f4a7cbffd17089ea98956 in term 0.
I20260928 13:05:26.202907 15920 leader_election.cc:302] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 047c27194a3f4a7cbffd17089ea98956, cf132a56325a48a2ba93b0085bde7fdf; no voters: 
I20260928 13:05:26.202961 16118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125eb815787747228ff69a2b593a0433" candidate_uuid: "047c27194a3f4a7cbffd17089ea98956" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d7d6b6528c40e595831e10229a53cd" is_pre_election: true
I20260928 13:05:26.203131 16118 raft_consensus.cc:2454] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 047c27194a3f4a7cbffd17089ea98956 in term 0.
I20260928 13:05:26.203135 16336 raft_consensus.cc:2781] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:05:26.203187 16336 raft_consensus.cc:482] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:05:26.203212 16336 raft_consensus.cc:3037] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:26.204030 16336 raft_consensus.cc:504] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.204164 16336 leader_election.cc:288] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [CANDIDATE]: Term 1 election: Requested vote from peers 85d7d6b6528c40e595831e10229a53cd (127.3.6.2:44741), cf132a56325a48a2ba93b0085bde7fdf (127.3.6.3:45877)
I20260928 13:05:26.204464 16118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125eb815787747228ff69a2b593a0433" candidate_uuid: "047c27194a3f4a7cbffd17089ea98956" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85d7d6b6528c40e595831e10229a53cd"
I20260928 13:05:26.204547 16118 raft_consensus.cc:3037] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:26.205363 16118 raft_consensus.cc:2454] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 047c27194a3f4a7cbffd17089ea98956 in term 1.
I20260928 13:05:26.205538 15918 leader_election.cc:302] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 047c27194a3f4a7cbffd17089ea98956, 85d7d6b6528c40e595831e10229a53cd; no voters: 
I20260928 13:05:26.205725 16252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125eb815787747228ff69a2b593a0433" candidate_uuid: "047c27194a3f4a7cbffd17089ea98956" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf132a56325a48a2ba93b0085bde7fdf"
I20260928 13:05:26.205801 16252 raft_consensus.cc:3037] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:26.206584 16252 raft_consensus.cc:2454] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 047c27194a3f4a7cbffd17089ea98956 in term 1.
I20260928 13:05:26.206781 16336 raft_consensus.cc:2781] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:26.206911 16336 raft_consensus.cc:686] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [term 1 LEADER]: Becoming Leader. State: Replica: 047c27194a3f4a7cbffd17089ea98956, State: Running, Role: LEADER
I20260928 13:05:26.207033 16336 consensus_queue.cc:237] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } }
I20260928 13:05:26.207850 15832 catalog_manager.cc:5495] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 reported cstate change: term changed from 0 to 1, leader changed from <none> to 047c27194a3f4a7cbffd17089ea98956 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "047c27194a3f4a7cbffd17089ea98956" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "047c27194a3f4a7cbffd17089ea98956" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 35601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 } health_report { overall_health: UNKNOWN } } }
Sep 28 13:05:26 dist-test-slave-ddvw krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600725, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for HTTP/127.3.6.20@KRBTEST.COM
I20260928 13:05:26.241999 16329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.238657 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59242 (local address 127.3.6.1:35601)
0928 13:05:26.238708 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:26.238710 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:26.238722 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:05:26.238791 (+    69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:26.238792 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:26.238815 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:26.238888 (+    73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:05:26.239033 (+   145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.239725 (+   692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.240847 (+  1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:26.241146 (+   299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:26.241213 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:26.241409 (+   196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:05:26.241542 (+   133us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:05:26.241621 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:26.241887 (+   266us) server_negotiation.cc:299] Negotiation successful
0928 13:05:26.241908 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:05:26.247323 16252 raft_consensus.cc:1261] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 1 FOLLOWER]: Refusing update from remote peer 047c27194a3f4a7cbffd17089ea98956: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:26.247380 16118 raft_consensus.cc:1261] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd [term 1 FOLLOWER]: Refusing update from remote peer 047c27194a3f4a7cbffd17089ea98956: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:26.247815 16336 consensus_queue.cc:1035] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85d7d6b6528c40e595831e10229a53cd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44741 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:26.247999 16336 consensus_queue.cc:1035] T 125eb815787747228ff69a2b593a0433 P 047c27194a3f4a7cbffd17089ea98956 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf132a56325a48a2ba93b0085bde7fdf" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:26.255167 15832 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:26.255267 15832 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:26.256443 15832 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9fa6544ccd3493cac8444262e8301b5: Sending DeleteTablet for 3 replicas of tablet 125eb815787747228ff69a2b593a0433
I20260928 13:05:26.256806 16232 tablet_service.cc:1514] Processing DeleteTablet for tablet 125eb815787747228ff69a2b593a0433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:26 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36974
I20260928 13:05:26.257068 15964 tablet_service.cc:1514] Processing DeleteTablet for tablet 125eb815787747228ff69a2b593a0433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:26 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:59238
I20260928 13:05:26.257390 16098 tablet_service.cc:1514] Processing DeleteTablet for tablet 125eb815787747228ff69a2b593a0433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:26 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36268
I20260928 13:05:26.258265  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15870
I20260928 13:05:26.258941 16354 tablet_replica.cc:330] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: stopping tablet replica
I20260928 13:05:26.259088 16354 raft_consensus.cc:2229] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:26.259169 16354 raft_consensus.cc:2258] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:26.260028 16347 mvcc.cc:205] Tried to move back new op lower bound from 7334300574706122752 to 7334300574544584704. Current Snapshot: MvccSnapshot[applied={T|T < 7334300574706122752}]
I20260928 13:05:26.262558 16356 tablet_replica.cc:330] T 125eb815787747228ff69a2b593a0433 P 85d7d6b6528c40e595831e10229a53cd: stopping tablet replica
W20260928 13:05:26.265658 15819 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:35601 (error 108)
I20260928 13:05:26.266292  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16034
I20260928 13:05:26.268534 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.268379 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:35601 (local address 127.0.0.1:59248)
0928 13:05:26.268434 (+    55us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.268494 (+    60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:35601: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260928 13:05:26.268697 15819 catalog_manager.cc:4584] TS 047c27194a3f4a7cbffd17089ea98956 (127.3.6.1:35601): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 125eb815787747228ff69a2b593a0433: Network error: Client connection negotiation failed: client connection to 127.3.6.1:35601: connect: Connection refused (error 111)
I20260928 13:05:26.272328 16354 ts_tablet_manager.cc:1905] T 125eb815787747228ff69a2b593a0433 P cf132a56325a48a2ba93b0085bde7fdf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:26.273890  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16167
I20260928 13:05:26.274086 16328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:26.273667 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44741 (local address 127.0.0.1:36276)
0928 13:05:26.274012 (+   345us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:26.274051 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:44741: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320}
I20260928 13:05:26.280805  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 15799
I20260928 13:05:26.288353  3096 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260928 13:05:26.633102  3096 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260928 13:05:26.633204  3096 mini_ranger.cc:66] Stopping Ranger...
I20260928 13:05:26.977574  3096 mini_ranger.cc:68] Stopped Ranger
2026-09-28 13:05:26.977 UTC [14866] LOG:  received smart shutdown request
2026-09-28 13:05:26.981 UTC [14866] LOG:  background worker "logical replication launcher" (PID 14875) exited with exit code 1
2026-09-28 13:05:26.981 UTC [14870] LOG:  shutting down
2026-09-28 13:05:27.151 UTC [14866] LOG:  database system is shut down
2026-09-28T13:05:27Z chronyd exiting
[       OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (47723 ms)
[ RUN      ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:05:27 dist-test-slave-ddvw krb5kdc[16369](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:05:27 dist-test-slave-ddvw krb5kdc[16369](info): set up 2 sockets
Sep 28 13:05:27 dist-test-slave-ddvw krb5kdc[16369](info): commencing operation
krb5kdc: starting...
W20260928 13:05:28.319283  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.037s	user 0.001s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:05:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:05:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:05:28.433602  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42651
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:28.516040 16382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:28.516278 16382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:28.516317 16382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:28.517561 16382 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:28.517619 16382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:28.517640 16382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:28.517663 16382 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:28.517690 16382 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:28.519300 16382 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16382
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:28.519572 16382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:28.519800 16382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:05:28.524621 16382 server_base.cc:1034] running on GCE node
W20260928 13:05:28.524569 16390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:28.524576 16387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:28.524592 16388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:28.525102 16382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:28.525404 16382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:28.526554 16382 hybrid_clock.cc:648] HybridClock initialized: now 1790600728526541 us; error 31 us; skew 500 ppm
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:28.529287 16382 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:28.529717 16382 webserver.cc:460] Webserver started at http://127.3.6.62:40695/ using document root <none> and password file <none>
I20260928 13:05:28.529966 16382 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:28.530011 16382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:28.530149 16382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:28.531303 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "e5b0867849324d93ab6feeb19cdd0d16"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "c7471227c31f7fb1aaa5489b9879cf69"
server_key_iv: "2de23a9a2e6beb5ce85f73291cc18429"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.531656 16382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "e5b0867849324d93ab6feeb19cdd0d16"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "c7471227c31f7fb1aaa5489b9879cf69"
server_key_iv: "2de23a9a2e6beb5ce85f73291cc18429"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.533031 16382 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:05:28.533816 16397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:28.533999 16382 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:28.534089 16382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "e5b0867849324d93ab6feeb19cdd0d16"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "c7471227c31f7fb1aaa5489b9879cf69"
server_key_iv: "2de23a9a2e6beb5ce85f73291cc18429"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.534163 16382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:28.553900 16382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:28.555958 16382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:28.556104 16382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:28.560123 16382 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42651
I20260928 13:05:28.560180 16449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42651 every 8 connection(s)
I20260928 13:05:28.560501 16382 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:28.561367 16450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:28.562942 16450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.568306  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16382
I20260928 13:05:28.568421  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:05:28.568629  3096 external_mini_cluster.cc:1428] Setting key ed6d380de935559b808f62b1b253e543
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:28.572865 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.563699 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.0.0.1:49472)
0928 13:05:28.563851 (+   152us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.563883 (+    32us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.564313 (+   430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.564605 (+   292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.564607 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.564866 (+   259us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.565045 (+   179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.565049 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.565997 (+   948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.565998 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.566660 (+   662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.566662 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.567110 (+   448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.567121 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.567177 (+    56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.567622 (+   445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.567629 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.569328 (+  1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.571455 (+  2127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.571461 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.571462 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.571644 (+   182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.571946 (+   302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.571947 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.571947 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.572021 (+    74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.572466 (+   445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.572471 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.572526 (+    55us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.572598 (+    72us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.572714 (+   116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":62,"threads_started":1}
I20260928 13:05:28.572947 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.563841 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49472 (local address 127.3.6.62:42651)
0928 13:05:28.563971 (+   130us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.563976 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.564013 (+    37us) server_negotiation.cc:407] Connection header received
0928 13:05:28.564460 (+   447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.564462 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.564478 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.564554 (+    76us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.565129 (+   575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.565921 (+   792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.566729 (+   808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.567048 (+   319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.567129 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.569407 (+  2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.569414 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.569414 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.569419 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.571373 (+  1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.571724 (+   351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.571728 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.571728 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.571874 (+   146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.572088 (+   214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.572089 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.572089 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.572380 (+   291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.572473 (+    93us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.572657 (+   184us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.572807 (+   150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":100,"thread_start_us":97,"threads_started":1}
I20260928 13:05:28.574200 16450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.574527 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.574425 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:38962)
0928 13:05:28.574473 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.574511 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 13:05:28.574656 16400 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
I20260928 13:05:28.575098 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.574992 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:38972)
0928 13:05:28.575051 (+    59us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.575075 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260928 13:05:28.575198 16450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44729: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.3.6.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
I20260928 13:05:28.593197  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:44729
--webserver_interface=127.3.6.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:28.624435 16450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } attempt: 1
I20260928 13:05:28.624984 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.624836 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:38986)
0928 13:05:28.624909 (+    73us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.624953 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260928 13:05:28.625350 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.625270 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:38992)
0928 13:05:28.625307 (+    37us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.625333 (+    26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260928 13:05:28.625458 16450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44729: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
W20260928 13:05:28.673151 16457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:28.673365 16457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:28.673388 16457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:28.674557 16457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:28.674599 16457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:28.674613 16457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:28.674626 16457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:28.674638 16457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:28.676208 16457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:44729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.6.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:28.676465 16457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:28.676698 16457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:28.681522 16465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:28.681504 16462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:28.681569 16457 server_base.cc:1034] running on GCE node
W20260928 13:05:28.681507 16463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:28.682055 16457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:28.682369 16457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:28.683526 16457 hybrid_clock.cc:648] HybridClock initialized: now 1790600728683513 us; error 28 us; skew 500 ppm
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:28.686008 16457 init.cc:377] Logged in from keytab as kudu/127.3.6.61@KRBTEST.COM (short username kudu)
I20260928 13:05:28.686508 16457 webserver.cc:460] Webserver started at http://127.3.6.61:40175/ using document root <none> and password file <none>
I20260928 13:05:28.686728 16457 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:28.686805 16457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:28.686956 16457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:28.688076 16457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data/instance:
uuid: "4ecf8eb6b7f5414f9f17dba883842167"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "e70c648f566aeb0e39806933b625feb6"
server_key_iv: "15e5f90f09af382afe92195bece49a03"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.688449 16457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal/instance:
uuid: "4ecf8eb6b7f5414f9f17dba883842167"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "e70c648f566aeb0e39806933b625feb6"
server_key_iv: "15e5f90f09af382afe92195bece49a03"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.689802 16457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:05:28.690546 16472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:28.690723 16457 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:28.690820 16457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "4ecf8eb6b7f5414f9f17dba883842167"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "e70c648f566aeb0e39806933b625feb6"
server_key_iv: "15e5f90f09af382afe92195bece49a03"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.690901 16457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:28.693598 16450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } attempt: 2
I20260928 13:05:28.694133 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.693963 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:39000)
0928 13:05:28.694039 (+    76us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.694094 (+    55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260928 13:05:28.694543 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.694433 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:39004)
0928 13:05:28.694495 (+    62us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.694520 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260928 13:05:28.694662 16450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44729: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44729: connect: Connection refused (error 111)
I20260928 13:05:28.698573 16457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:28.700837 16457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:28.700996 16457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:28.705156 16457 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.61:44729
I20260928 13:05:28.705188 16524 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.61:44729 every 8 connection(s)
I20260928 13:05:28.705557 16457 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
I20260928 13:05:28.706423 16525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:28.707469  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16457
I20260928 13:05:28.707602  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-1/wal/instance
I20260928 13:05:28.707787  3096 external_mini_cluster.cc:1428] Setting key cd264ea57c40c12413aa43199c0fd49c
I20260928 13:05:28.708207 16525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.60@KRBTEST.COM; defaulting to no policy
I20260928 13:05:28.718179 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.709018 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.3.6.62:42651)
0928 13:05:28.709074 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.709076 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.709295 (+   219us) server_negotiation.cc:407] Connection header received
0928 13:05:28.709727 (+   432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.709728 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.709746 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.709838 (+    92us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.710446 (+   608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.711245 (+   799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.712333 (+  1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.712710 (+   377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.712797 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.715510 (+  2713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.715511 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.715511 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.715519 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.717047 (+  1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.717412 (+   365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.717413 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.717413 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.717464 (+    51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.717638 (+   174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.717638 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.717638 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.717735 (+    97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.717783 (+    48us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.718046 (+   263us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.718111 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.60@KRBTEST.COM" created.
I20260928 13:05:28.718425 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.708976 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.0.0.1:49480)
0928 13:05:28.709151 (+   175us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.709191 (+    40us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.709632 (+   441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.709898 (+   266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.709901 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.710167 (+   266us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.710357 (+   190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.710361 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.711358 (+   997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.711359 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.712228 (+   869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.712230 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.712828 (+   598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.712840 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.712944 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.713510 (+   566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.713525 (+    15us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.715396 (+  1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.717119 (+  1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.717125 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.717127 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.717347 (+   220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.717504 (+   157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.717505 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.717505 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.717590 (+    85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.717818 (+   228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.717822 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.717939 (+   117us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.718022 (+    83us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.718160 (+   138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":92,"threads_started":1}
I20260928 13:05:28.718905 16525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:05:28.726413 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.719197 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:39018)
0928 13:05:28.719258 (+    61us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.719267 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.719317 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.719572 (+   255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.719572 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.719712 (+   140us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.719751 (+    39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.719752 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.720630 (+   878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.720631 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.721117 (+   486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.721119 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.721603 (+   484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.721606 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.721672 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.722095 (+   423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.722100 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.723562 (+  1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.725370 (+  1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.725371 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.725371 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.725533 (+   162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.725756 (+   223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.725757 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.725757 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.725808 (+    51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.726098 (+   290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.726098 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.726136 (+    38us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.726197 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.726304 (+   107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260928 13:05:28.726512 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.719270 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39018 (local address 127.3.6.61:44729)
0928 13:05:28.719443 (+   173us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.719447 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.719462 (+    15us) server_negotiation.cc:407] Connection header received
0928 13:05:28.719478 (+    16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.719480 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.719490 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.719572 (+    82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.719829 (+   257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.720535 (+   706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.721213 (+   678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.721509 (+   296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.721605 (+    96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.723659 (+  2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.723667 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.723667 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.723674 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.725271 (+  1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.725624 (+   353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.725627 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.725628 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.725682 (+    54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.725877 (+   195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.725878 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.725879 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.726021 (+   142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.726108 (+    87us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.726232 (+   124us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.726354 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":149,"thread_start_us":101,"threads_started":1}
I20260928 13:05:28.727279 16525 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.727689 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.727554 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43920)
0928 13:05:28.727608 (+    54us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.727660 (+    52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260928 13:05:28.727833 16476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
I20260928 13:05:28.728266 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.728173 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43936)
0928 13:05:28.728195 (+    22us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.728241 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260928 13:05:28.728420 16525 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:42311: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
I20260928 13:05:28.733168  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:42311
--webserver_interface=127.3.6.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:28.777642 16525 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } attempt: 1
I20260928 13:05:28.778126 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.777988 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43940)
0928 13:05:28.778060 (+    72us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.778096 (+    36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260928 13:05:28.778465 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.778371 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43952)
0928 13:05:28.778415 (+    44us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.778442 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:05:28.778545 16525 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:42311: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
I20260928 13:05:28.785815 16450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } attempt: 3
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:05:28.793226 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.786194 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:39030)
0928 13:05:28.786254 (+    60us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.786276 (+    22us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.786323 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.786501 (+   178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.786503 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.786684 (+   181us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.786759 (+    75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.786761 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.787485 (+   724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.787486 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.788315 (+   829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.788318 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.788666 (+   348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.788669 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.788764 (+    95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.789228 (+   464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.789234 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.790551 (+  1317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.792174 (+  1623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.792175 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.792176 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.792352 (+   176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.792575 (+   223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.792576 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.792577 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.792648 (+    71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.792900 (+   252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.792901 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.792954 (+    53us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.793022 (+    68us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.793124 (+   102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260928 13:05:28.793236 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.786251 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39030 (local address 127.3.6.61:44729)
0928 13:05:28.786308 (+    57us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.786310 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.786328 (+    18us) server_negotiation.cc:407] Connection header received
0928 13:05:28.786385 (+    57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.786386 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.786397 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.786471 (+    74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.786832 (+   361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.787388 (+   556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.788401 (+  1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.788601 (+   200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.788649 (+    48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.790658 (+  2009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.790660 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.790660 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.790666 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.792076 (+  1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.792445 (+   369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.792447 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.792447 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.792507 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.792714 (+   207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.792715 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.792715 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.792831 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.792908 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.793044 (+   136us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.793125 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 13:05:28.793609 16450 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.793987 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.793886 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43964)
0928 13:05:28.793938 (+    52us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.793967 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 13:05:28.794345 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.794255 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43972)
0928 13:05:28.794300 (+    45us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.794323 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:05:28.794449 16450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:42311: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
W20260928 13:05:28.817674 16532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:28.817917 16532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:28.817955 16532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:28.819229 16532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:28.819293 16532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:28.819316 16532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:28.819343 16532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:28.819375 16532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:28.820936 16532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42651,127.3.6.61:44729,127.3.6.60:42311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:42311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.6.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:28.821219 16532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:28.821450 16532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:05:28.825649 16450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } attempt: 1
I20260928 13:05:28.826146 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.825945 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43974)
0928 13:05:28.826033 (+    88us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.826075 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 13:05:28.826337 16532 server_base.cc:1034] running on GCE node
I20260928 13:05:28.826543 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.826430 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43976)
0928 13:05:28.826478 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.826511 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:05:28.826547 16538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:28.826490 16540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:28.826635 16450 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:42311: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
W20260928 13:05:28.826491 16537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:28.827054 16532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:28.827356 16532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:28.828521 16532 hybrid_clock.cc:648] HybridClock initialized: now 1790600728828499 us; error 38 us; skew 500 ppm
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:28.831079 16532 init.cc:377] Logged in from keytab as kudu/127.3.6.60@KRBTEST.COM (short username kudu)
I20260928 13:05:28.831496 16532 webserver.cc:460] Webserver started at http://127.3.6.60:44145/ using document root <none> and password file <none>
I20260928 13:05:28.831725 16532 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:28.831792 16532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:28.831956 16532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:28.833016 16532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data/instance:
uuid: "ecf3ea65a42246bcaaa31857b35b7fca"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "a1e280dc154e79d06e4775c62d917786"
server_key_iv: "c82e4d2130607896b576765498e0c78e"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.833374 16532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal/instance:
uuid: "ecf3ea65a42246bcaaa31857b35b7fca"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "a1e280dc154e79d06e4775c62d917786"
server_key_iv: "c82e4d2130607896b576765498e0c78e"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.834687 16532 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:05:28.835489 16547 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:28.835650 16532 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:28.835747 16532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "ecf3ea65a42246bcaaa31857b35b7fca"
format_stamp: "Formatted at 2026-09-28 13:05:28 on dist-test-slave-ddvw"
server_key: "a1e280dc154e79d06e4775c62d917786"
server_key_iv: "c82e4d2130607896b576765498e0c78e"
server_key_version: "encryptionkey@0"
I20260928 13:05:28.835829 16532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:28.846704 16525 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } attempt: 2
I20260928 13:05:28.847266 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.847132 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43984)
0928 13:05:28.847194 (+    62us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.847233 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 13:05:28.847358 16532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:28.847788 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.847670 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:43998)
0928 13:05:28.847729 (+    59us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.847759 (+    30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260928 13:05:28.847925 16525 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:42311: Network error: Client connection negotiation failed: client connection to 127.3.6.60:42311: connect: Connection refused (error 111)
I20260928 13:05:28.849431 16532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:28.849589 16532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:28.853605 16532 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.60:42311
I20260928 13:05:28.853634 16599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.60:42311 every 8 connection(s)
I20260928 13:05:28.853984 16532 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
I20260928 13:05:28.854835 16600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:28.856377 16600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.857951  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16532
I20260928 13:05:28.858062  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790600576430005-3096-0/minicluster-data/master-2/wal/instance
I20260928 13:05:28.858244  3096 external_mini_cluster.cc:1428] Setting key 8bc8aaf63f6453fa446d5fec07bb5dac
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:05:28.866173 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.857229 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49490 (local address 127.3.6.62:42651)
0928 13:05:28.857289 (+    60us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.857291 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.857516 (+   225us) server_negotiation.cc:407] Connection header received
0928 13:05:28.858042 (+   526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.858044 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.858057 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.858113 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.858883 (+   770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.859430 (+   547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.860404 (+   974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.860637 (+   233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.860720 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.863211 (+  2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.863212 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.863213 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.863220 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.864778 (+  1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.865162 (+   384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.865163 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.865164 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.865222 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.865457 (+   235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.865458 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.865458 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.865603 (+   145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.865666 (+    63us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.865986 (+   320us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.866071 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:05:28.866360 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.857199 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42651 (local address 127.0.0.1:49490)
0928 13:05:28.857401 (+   202us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.857435 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.857927 (+   492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.858183 (+   256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.858186 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.858504 (+   318us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.858784 (+   280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.858790 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.859526 (+   736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.859528 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.860301 (+   773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.860303 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.860713 (+   410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.860724 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.860865 (+   141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.861387 (+   522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.861396 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.863127 (+  1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.864850 (+  1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.864855 (+     5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.864856 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.865091 (+   235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.865299 (+   208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.865299 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.865299 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.865392 (+    93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.865668 (+   276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.865674 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.865831 (+   157us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.865943 (+   112us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.866104 (+   161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":90,"threads_started":1}
I20260928 13:05:28.866941 16600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.867265 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.858632 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44014 (local address 127.3.6.60:42311)
0928 13:05:28.858801 (+   169us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.858805 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.858830 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:05:28.858892 (+    62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.858895 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.858914 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.858999 (+    85us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.859570 (+   571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.860297 (+   727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.861016 (+   719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.861317 (+   301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.861410 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.863900 (+  2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.863907 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.863908 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.863915 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.865561 (+  1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.865969 (+   408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.865971 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.865972 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.866031 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.866612 (+   581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.866613 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.866613 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.866772 (+   159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.866924 (+   152us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.867058 (+   134us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.867135 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":109,"threads_started":1}
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:28.873953 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.867256 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44729 (local address 127.0.0.1:39038)
0928 13:05:28.867315 (+    59us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.867326 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.867368 (+    42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.867649 (+   281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.867650 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.867809 (+   159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.867887 (+    78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.867889 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.868601 (+   712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.868601 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.869107 (+   506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.869109 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.869480 (+   371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.869482 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.869552 (+    70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.869959 (+   407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.869963 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.871256 (+  1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.872901 (+  1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.872902 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.872903 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.873076 (+   173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.873297 (+   221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.873298 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.873298 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.873381 (+    83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.873640 (+   259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.873641 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.873683 (+    42us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.873761 (+    78us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.873855 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:05:28.873963 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.867364 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39038 (local address 127.3.6.61:44729)
0928 13:05:28.867531 (+   167us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.867534 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.867542 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:05:28.867567 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.867568 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.867578 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.867638 (+    60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.867967 (+   329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.868517 (+   550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.869190 (+   673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.869392 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.869482 (+    90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.871338 (+  1856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.871340 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.871340 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.871348 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.872764 (+  1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.873168 (+   404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.873169 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.873170 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.873231 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.873454 (+   223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.873455 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.873456 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.873568 (+   112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.873638 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.873798 (+   160us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.873880 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260928 13:05:28.874310 16600 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:05:28.875334 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.868079 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.3.6.62:42651)
0928 13:05:28.868135 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.868137 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.868144 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:05:28.868162 (+    18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.868163 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.868171 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.868221 (+    50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.868654 (+   433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.869111 (+   457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.869797 (+   686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.870126 (+   329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.870198 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.872655 (+  2457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.872656 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.872657 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.872664 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.874167 (+  1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.874518 (+   351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.874520 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.874520 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.874575 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.874800 (+   225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.874801 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.874801 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.874931 (+   130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.875131 (+   200us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.875170 (+    39us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.875244 (+    74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:05:28.881345 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.874647 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44026 (local address 127.3.6.60:42311)
0928 13:05:28.874685 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.874687 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.874705 (+    18us) server_negotiation.cc:407] Connection header received
0928 13:05:28.874728 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.874729 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.874737 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.874802 (+    65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.875077 (+   275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.875813 (+   736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.876460 (+   647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.876666 (+   206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.876747 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.878502 (+  1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.878503 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.878503 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.878508 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.880095 (+  1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.880501 (+   406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.880502 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.880503 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.880557 (+    54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.880756 (+   199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.880757 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.880757 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.880901 (+   144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.880970 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.881170 (+   200us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.881261 (+    91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":22}
I20260928 13:05:28.881389 16602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.874591 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:44026)
0928 13:05:28.874633 (+    42us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.874643 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.874677 (+    34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.874807 (+   130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.874807 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.874928 (+   121us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.874955 (+    27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.874956 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.875897 (+   941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.875898 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.876361 (+   463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.876362 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.876744 (+   382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.876746 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.876794 (+    48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.877166 (+   372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.877169 (+     3us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.878424 (+  1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.880207 (+  1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.880208 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.880208 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.880415 (+   207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.880620 (+   205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.880621 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.880621 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.880673 (+    52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.880979 (+   306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.880980 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.881044 (+    64us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.881119 (+    75us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.881218 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260928 13:05:28.883339 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.875975 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39042 (local address 127.3.6.61:44729)
0928 13:05:28.876009 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.876011 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.876051 (+    40us) server_negotiation.cc:407] Connection header received
0928 13:05:28.876118 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.876119 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.876128 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.876181 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.876617 (+   436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.877189 (+   572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.878051 (+   862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.878302 (+   251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.878363 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.880680 (+  2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.880681 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.880682 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.880688 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.882282 (+  1594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.882662 (+   380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.882663 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.882663 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.882708 (+    45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.882892 (+   184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.882893 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.882893 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.882997 (+   104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.883199 (+   202us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.883229 (+    30us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.883283 (+    54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:05:28.883579 16600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: Bootstrap starting.
I20260928 13:05:28.884558 16600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:28.884589  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:05:28.884847 16600 log.cc:824] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:28.885638 16600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: No bootstrap required, opened a new log
I20260928 13:05:28.887909 16600 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.888173 16600 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:28.888263 16600 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecf3ea65a42246bcaaa31857b35b7fca, State: Initialized, Role: FOLLOWER
I20260928 13:05:28.888474 16600 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.888886 16600 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: configured and running, proceeding with master startup.
W20260928 13:05:28.892774 16624 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:05:28.892877 16624 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:05:28.893047 16613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:28.893337 16613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:05:28.894300 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.886053 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44028 (local address 127.3.6.60:42311)
0928 13:05:28.886090 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.886091 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.887178 (+  1087us) server_negotiation.cc:407] Connection header received
0928 13:05:28.887273 (+    95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.887274 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.887283 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.887311 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.887952 (+   641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.888635 (+   683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.889552 (+   917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.889822 (+   270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.889860 (+    38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.891419 (+  1559us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.891420 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.891420 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.891426 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.892989 (+  1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.893363 (+   374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.893364 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.893364 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.893416 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.893621 (+   205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.893622 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.893622 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.893784 (+   162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.893864 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.894111 (+   247us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.894194 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:05:28.894654 16529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.886212 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39056 (local address 127.3.6.61:44729)
0928 13:05:28.886246 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.886247 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.886483 (+   236us) server_negotiation.cc:407] Connection header received
0928 13:05:28.886561 (+    78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.886562 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.886571 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.886614 (+    43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.887261 (+   647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.887996 (+   735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.888987 (+   991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.889272 (+   285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.889309 (+    37us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.891455 (+  2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.891456 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.891456 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.891463 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.893206 (+  1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.893635 (+   429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.893636 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.893637 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.893690 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.893902 (+   212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.893904 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.893904 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.894020 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.894135 (+   115us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.894482 (+   347us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.894575 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 13:05:28.892009 16532 master_runner.cc:186] Error getting master registration for 127.3.6.62:42651: OK, instance_id { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" instance_seqno: 1790600728558984 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:05:28.895162 16532 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:05:28.897410 16453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.886167 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49504 (local address 127.3.6.62:42651)
0928 13:05:28.886206 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.886208 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.886336 (+   128us) server_negotiation.cc:407] Connection header received
0928 13:05:28.886380 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.886382 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.886393 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.886452 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.887216 (+   764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.887925 (+   709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.888985 (+  1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.889268 (+   283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.889315 (+    47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.891064 (+  1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.891065 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.891066 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.891073 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.896328 (+  5255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.896640 (+   312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.896641 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.896641 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.896705 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.896937 (+   232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.896938 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.896938 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.897068 (+   130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.897172 (+   104us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.897242 (+    70us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.897324 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:05:28.901779 16450 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } attempt: 2
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:05:28.909155 16452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.902063 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:44044)
0928 13:05:28.902124 (+    61us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.902136 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.902180 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.902341 (+   161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.902342 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.902512 (+   170us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.902562 (+    50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.902564 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.903522 (+   958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.903523 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.904043 (+   520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.904044 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.904502 (+   458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.904504 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.904544 (+    40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.904998 (+   454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.905003 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.906411 (+  1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.908154 (+  1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.908155 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.908155 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.908326 (+   171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.908529 (+   203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.908529 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.908530 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.908584 (+    54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.908920 (+   336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.908921 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.908961 (+    40us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.909018 (+    57us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.909089 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:05:28.909220 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.902146 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44044 (local address 127.3.6.60:42311)
0928 13:05:28.902194 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.902196 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.902204 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:05:28.902237 (+    33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.902238 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.902254 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.902322 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.902622 (+   300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.903443 (+   821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.904126 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.904425 (+   299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.904495 (+    70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.906490 (+  1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.906491 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.906491 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.906498 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.908071 (+  1573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.908399 (+   328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.908400 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.908400 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.908464 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.908701 (+   237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.908702 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.908702 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.908853 (+   151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.908927 (+    74us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.909058 (+   131us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.909131 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260928 13:05:28.910651 16450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: Bootstrap starting.
I20260928 13:05:28.911363 16450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:28.911646 16450 log.cc:824] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:28.912706 16450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: No bootstrap required, opened a new log
I20260928 13:05:28.914108 16450 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.914243 16450 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:28.914319 16450 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b0867849324d93ab6feeb19cdd0d16, State: Initialized, Role: FOLLOWER
I20260928 13:05:28.914489 16450 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.914788 16627 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:28.914852 16450 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:28.914871 16627 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:05:28.916738 16638 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:05:28.916988 16638 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:05:28.917378 16382 master_runner.cc:186] Error getting master registration for 127.3.6.61:44729: OK, instance_id { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" instance_seqno: 1790600728704037 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:05:28.920296 16382 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:05:28.939086 16525 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } attempt: 3
Sep 28 13:05:28 dist-test-slave-ddvw krb5kdc[16369](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600728, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:05:28.948045 16528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.939422 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:42311 (local address 127.0.0.1:44056)
0928 13:05:28.939533 (+   111us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:28.939545 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:28.939600 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:28.940199 (+   599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:28.940200 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:28.940400 (+   200us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:28.940462 (+    62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.940464 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.941393 (+   929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.941394 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.942241 (+   847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:28.942244 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.942731 (+   487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.942734 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:28.942803 (+    69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.943382 (+   579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:28.943388 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:28.944939 (+  1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:28.946813 (+  1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.946814 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.946815 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.947079 (+   264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.947329 (+   250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:28.947330 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:28.947331 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:28.947417 (+    86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:28.947714 (+   297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:28.947715 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:28.947764 (+    49us) client_negotiation.cc:769] Sending connection context
0928 13:05:28.947838 (+    74us) client_negotiation.cc:240] Negotiation successful
0928 13:05:28.947936 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260928 13:05:28.948050 16604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:28.939704 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44056 (local address 127.3.6.60:42311)
0928 13:05:28.940055 (+   351us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:28.940058 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:28.940066 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:05:28.940093 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:28.940094 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:28.940104 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:28.940166 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:28.940545 (+   379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.941294 (+   749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.942330 (+  1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:28.942650 (+   320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:28.942723 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:28.945031 (+  2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:28.945033 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:28.945033 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:28.945041 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:28.946725 (+  1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.947191 (+   466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.947192 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.947192 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.947255 (+    63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:28.947504 (+   249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:28.947505 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:28.947505 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:28.947643 (+   138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:28.947711 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:28.947876 (+   165us) server_negotiation.cc:299] Negotiation successful
0928 13:05:28.947954 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327}
I20260928 13:05:28.950351 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: Bootstrap starting.
I20260928 13:05:28.951149 16525 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:28.951447 16525 log.cc:824] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:28.952303 16525 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: No bootstrap required, opened a new log
I20260928 13:05:28.954336 16525 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.954475 16525 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:28.954509 16525 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ecf8eb6b7f5414f9f17dba883842167, State: Initialized, Role: FOLLOWER
I20260928 13:05:28.954682 16525 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:28.954998 16525 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:28.954958 16641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:28.955178 16641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:05:28.956789 16652 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:05:28.956892 16652 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:05:28.958792 16457 master_runner.cc:263] No leader master found from master 4ecf8eb6b7f5414f9f17dba883842167
I20260928 13:05:28.958835 16457 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260928 13:05:29.056885 16403 tablet.cc:2369] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:05:29.100216 16553 tablet.cc:2369] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:05:29.138203 16627 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:29.138319 16627 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:29.138609 16627 leader_election.cc:288] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ecf8eb6b7f5414f9f17dba883842167 (127.3.6.61:44729), ecf3ea65a42246bcaaa31857b35b7fca (127.3.6.60:42311)
I20260928 13:05:29.138895 16574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5b0867849324d93ab6feeb19cdd0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" is_pre_election: true
I20260928 13:05:29.138916 16499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5b0867849324d93ab6feeb19cdd0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecf8eb6b7f5414f9f17dba883842167" is_pre_election: true
I20260928 13:05:29.139096 16499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b0867849324d93ab6feeb19cdd0d16 in term 0.
I20260928 13:05:29.139104 16574 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5b0867849324d93ab6feeb19cdd0d16 in term 0.
I20260928 13:05:29.139274 16401 leader_election.cc:302] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5b0867849324d93ab6feeb19cdd0d16, ecf3ea65a42246bcaaa31857b35b7fca; no voters: 
I20260928 13:05:29.139457 16627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:05:29.139518 16627 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:05:29.139542 16627 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:29.140296 16627 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:29.140439 16627 leader_election.cc:288] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [CANDIDATE]: Term 1 election: Requested vote from peers 4ecf8eb6b7f5414f9f17dba883842167 (127.3.6.61:44729), ecf3ea65a42246bcaaa31857b35b7fca (127.3.6.60:42311)
I20260928 13:05:29.140580 16499 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5b0867849324d93ab6feeb19cdd0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ecf8eb6b7f5414f9f17dba883842167"
I20260928 13:05:29.140614 16574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5b0867849324d93ab6feeb19cdd0d16" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecf3ea65a42246bcaaa31857b35b7fca"
I20260928 13:05:29.140676 16499 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:29.140677 16574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:29.141362 16574 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b0867849324d93ab6feeb19cdd0d16 in term 1.
I20260928 13:05:29.141372 16499 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5b0867849324d93ab6feeb19cdd0d16 in term 1.
I20260928 13:05:29.141530 16400 leader_election.cc:302] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ecf8eb6b7f5414f9f17dba883842167, e5b0867849324d93ab6feeb19cdd0d16; no voters: 
I20260928 13:05:29.141644 16627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:29.141768 16627 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [term 1 LEADER]: Becoming Leader. State: Replica: e5b0867849324d93ab6feeb19cdd0d16, State: Running, Role: LEADER
I20260928 13:05:29.141877 16627 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } }
I20260928 13:05:29.142311 16654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5b0867849324d93ab6feeb19cdd0d16. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.142429 16654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:29.142621 16656 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:29.142812 16656 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:29.144210 16499 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [term 1 FOLLOWER]: Refusing update from remote peer e5b0867849324d93ab6feeb19cdd0d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:29.144332 16574 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [term 1 FOLLOWER]: Refusing update from remote peer e5b0867849324d93ab6feeb19cdd0d16: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:29.144606 16654 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:29.144707 16627 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:29.145893 16641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5b0867849324d93ab6feeb19cdd0d16. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.145890 16613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5b0867849324d93ab6feeb19cdd0d16. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.145983 16613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:05:29.146003 16641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:05:29.146633 16657 mvcc.cc:205] Tried to move back new op lower bound from 7334300586572406784 to 7334300586565808128. Current Snapshot: MvccSnapshot[applied={T|T < 7334300586572406784}]
I20260928 13:05:29.146720 16654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.146798 16654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:29.146838 16654 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.146878 16654 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:29.147027 16613 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.147106 16613 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:05:29.147101 16641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e5b0867849324d93ab6feeb19cdd0d16" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5b0867849324d93ab6feeb19cdd0d16" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42651 } } peers { permanent_uuid: "4ecf8eb6b7f5414f9f17dba883842167" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44729 } } peers { permanent_uuid: "ecf3ea65a42246bcaaa31857b35b7fca" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 42311 } } }
I20260928 13:05:29.147148 16656 catalog_manager.cc:1347] Generated new cluster ID: 7c29b40070d74197a3da25f6618bedbd
I20260928 13:05:29.147176 16641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:05:29.147183 16656 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:05:29.147328 16659 mvcc.cc:205] Tried to move back new op lower bound from 7334300586572406784 to 7334300586565808128. Current Snapshot: MvccSnapshot[applied={T|T < 7334300586572406784}]
I20260928 13:05:29.147364 16658 mvcc.cc:205] Tried to move back new op lower bound from 7334300586572406784 to 7334300586565808128. Current Snapshot: MvccSnapshot[applied={T|T < 7334300586572406784 or (T in {7334300586572406784})}]
I20260928 13:05:29.163798 16656 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:05:29.164561 16656 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:29.171540 16656 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5b0867849324d93ab6feeb19cdd0d16: Generated new TSK 0
I20260928 13:05:29.171789 16656 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:05:29.893471 16624 catalog_manager.cc:1259] Loaded cluster ID: 7c29b40070d74197a3da25f6618bedbd
I20260928 13:05:29.893549 16624 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: loading cluster ID for follower catalog manager: success
I20260928 13:05:29.894515 16624 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: acquiring CA information for follower catalog manager: success
I20260928 13:05:29.894860 16624 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecf3ea65a42246bcaaa31857b35b7fca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:05:29.957335 16652 catalog_manager.cc:1259] Loaded cluster ID: 7c29b40070d74197a3da25f6618bedbd
I20260928 13:05:29.957435 16652 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: loading cluster ID for follower catalog manager: success
I20260928 13:05:29.958262 16652 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: acquiring CA information for follower catalog manager: success
I20260928 13:05:29.958578 16652 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4ecf8eb6b7f5414f9f17dba883842167: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:05:30.227979  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16382
I20260928 13:05:30.233376  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16457
I20260928 13:05:30.238104  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16532
2026-09-28T13:05:30Z chronyd exiting
[       OK ] SecurityITest.IPKICACert (2975 ms)
[ RUN      ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:05:30 dist-test-slave-ddvw krb5kdc[16671](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:05:30 dist-test-slave-ddvw krb5kdc[16671](info): set up 2 sockets
Sep 28 13:05:30 dist-test-slave-ddvw krb5kdc[16671](info): commencing operation
krb5kdc: starting...
W20260928 13:05:31.283113  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.025s	user 0.002s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:05:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:05:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:05:31.398070  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38407
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:38407
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:31.479427 16684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:31.479667 16684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:31.479707 16684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:31.480919 16684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:31.480993 16684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:31.481021 16684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:31.481053 16684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:31.481087 16684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:31.482650 16684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:38407
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:31.482920 16684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:31.483181 16684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:31.488027 16689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:31.488023 16692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:31.488229 16690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:31.488330 16684 server_base.cc:1034] running on GCE node
I20260928 13:05:31.488584 16684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:31.488893 16684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:31.490062 16684 hybrid_clock.cc:648] HybridClock initialized: now 1790600731490048 us; error 51 us; skew 500 ppm
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16671](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600731, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:31.492710 16684 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:31.493207 16684 webserver.cc:460] Webserver started at http://127.3.6.62:40205/ using document root <none> and password file <none>
I20260928 13:05:31.493462 16684 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:31.493533 16684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:31.493680 16684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:31.494808 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "46af7bcd5d35476dab07fa40e6faab9e"
format_stamp: "Formatted at 2026-09-28 13:05:31 on dist-test-slave-ddvw"
server_key: "2a53bbfdf32f12d7d03544891e89fe7d"
server_key_iv: "fc895ceece91830863e46e05edd3b1be"
server_key_version: "encryptionkey@0"
I20260928 13:05:31.495213 16684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "46af7bcd5d35476dab07fa40e6faab9e"
format_stamp: "Formatted at 2026-09-28 13:05:31 on dist-test-slave-ddvw"
server_key: "2a53bbfdf32f12d7d03544891e89fe7d"
server_key_iv: "fc895ceece91830863e46e05edd3b1be"
server_key_version: "encryptionkey@0"
I20260928 13:05:31.496631 16684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:05:31.497480 16699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:31.497660 16684 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:31.497756 16684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "46af7bcd5d35476dab07fa40e6faab9e"
format_stamp: "Formatted at 2026-09-28 13:05:31 on dist-test-slave-ddvw"
server_key: "2a53bbfdf32f12d7d03544891e89fe7d"
server_key_iv: "fc895ceece91830863e46e05edd3b1be"
server_key_version: "encryptionkey@0"
I20260928 13:05:31.497889 16684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:31.508158 16684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:31.510102 16684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:31.510269 16684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:31.514189 16684 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:38407
I20260928 13:05:31.514219 16751 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:38407 every 8 connection(s)
I20260928 13:05:31.514561 16684 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:31.515513 16752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:31.517725 16752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e: Bootstrap starting.
I20260928 13:05:31.518292 16752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:31.518580 16752 log.cc:824] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:31.519307 16752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e: No bootstrap required, opened a new log
I20260928 13:05:31.520882 16752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } }
I20260928 13:05:31.521025 16752 raft_consensus.cc:374] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:31.521049 16752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46af7bcd5d35476dab07fa40e6faab9e, State: Initialized, Role: FOLLOWER
I20260928 13:05:31.521215 16752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } }
I20260928 13:05:31.521276 16752 raft_consensus.cc:388] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:31.521297 16752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:31.521359 16752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:31.521910 16752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } }
I20260928 13:05:31.521996 16752 leader_election.cc:302] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 46af7bcd5d35476dab07fa40e6faab9e; no voters: 
I20260928 13:05:31.522166 16752 leader_election.cc:288] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:05:31.522256 16755 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:31.522441 16755 raft_consensus.cc:686] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [term 1 LEADER]: Becoming Leader. State: Replica: 46af7bcd5d35476dab07fa40e6faab9e, State: Running, Role: LEADER
I20260928 13:05:31.522521 16752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:31.522553 16755 consensus_queue.cc:237] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } }
I20260928 13:05:31.522740  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16684
I20260928 13:05:31.522850  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:05:31.523175  3096 external_mini_cluster.cc:1428] Setting key 007991d7d90538fdfa1f6ea334a3d457
I20260928 13:05:31.523291 16756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "46af7bcd5d35476dab07fa40e6faab9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } } }
I20260928 13:05:31.523384 16756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:31.523550 16757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 46af7bcd5d35476dab07fa40e6faab9e. Latest consensus state: current_term: 1 leader_uuid: "46af7bcd5d35476dab07fa40e6faab9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "46af7bcd5d35476dab07fa40e6faab9e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38407 } } }
I20260928 13:05:31.523672 16757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:31.523716 16764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:31.524245 16764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:31.525789 16764 catalog_manager.cc:1347] Generated new cluster ID: eb8ed973722b4fb79376263d12b2f651
I20260928 13:05:31.525840 16764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16671](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:31.534930 16767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:31.523750 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.3.6.62:38407)
0928 13:05:31.523898 (+   148us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:31.523909 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:31.523945 (+    36us) server_negotiation.cc:407] Connection header received
0928 13:05:31.524077 (+   132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:31.524085 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:31.524154 (+    69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:31.525185 (+  1031us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:31.525280 (+    95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:31.526665 (+  1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:31.527761 (+  1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:31.528397 (+   636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:31.528515 (+   118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:31.531241 (+  2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:31.531247 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:31.531247 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:31.531262 (+    15us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:31.533292 (+  2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:31.533690 (+   398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:31.533694 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:31.533694 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:31.533813 (+   119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:31.534016 (+   203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:31.534017 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:31.534017 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:31.534342 (+   325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:31.534509 (+   167us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:31.534582 (+    73us) server_negotiation.cc:299] Negotiation successful
0928 13:05:31.534718 (+   136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
I20260928 13:05:31.535537 16764 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:05:31.536039  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:05:31.536072 16764 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:31.547605 16764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 46af7bcd5d35476dab07fa40e6faab9e: Generated new TSK 0
I20260928 13:05:31.547824 16764 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:05:31.590102  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16684
2026-09-28T13:05:31Z chronyd exiting
[       OK ] SecurityITest.IPKICACertWebServerEndPoints (1350 ms)
[ RUN      ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16779](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16779](info): set up 2 sockets
Sep 28 13:05:31 dist-test-slave-ddvw krb5kdc[16779](info): commencing operation
krb5kdc: starting...
W20260928 13:05:32.631206  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.023s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:05:32 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:05:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:05:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:05:32.749943  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:32.830773 16792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:32.831036 16792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:32.831110 16792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:32.832295 16792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:32.832374 16792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:32.832401 16792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:32.832433 16792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:32.832458 16792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:32.834062 16792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:32.834339 16792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:32.834568 16792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:32.839643 16800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:32.839670 16798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:32.839746 16792 server_base.cc:1034] running on GCE node
W20260928 13:05:32.839682 16797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:32.840052 16792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:32.840299 16792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:32.841439 16792 hybrid_clock.cc:648] HybridClock initialized: now 1790600732841429 us; error 50 us; skew 500 ppm
Sep 28 13:05:32 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600732, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:32.844022 16792 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:32.844489 16792 webserver.cc:460] Webserver started at http://127.3.6.62:41561/ using document root <none> and password file <none>
I20260928 13:05:32.844722 16792 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:32.844789 16792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:32.844954 16792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:32.846030 16792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "9ebb37a150714023bb82bd30e617cf54"
format_stamp: "Formatted at 2026-09-28 13:05:32 on dist-test-slave-ddvw"
server_key: "6e6cd06738ab1c594fac77533d3b58da"
server_key_iv: "d9b1b3e33dc839913e5343ab6d5abbe0"
server_key_version: "encryptionkey@0"
I20260928 13:05:32.846405 16792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "9ebb37a150714023bb82bd30e617cf54"
format_stamp: "Formatted at 2026-09-28 13:05:32 on dist-test-slave-ddvw"
server_key: "6e6cd06738ab1c594fac77533d3b58da"
server_key_iv: "d9b1b3e33dc839913e5343ab6d5abbe0"
server_key_version: "encryptionkey@0"
I20260928 13:05:32.847826 16792 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:05:32.848587 16807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:32.848758 16792 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:32.848872 16792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "9ebb37a150714023bb82bd30e617cf54"
format_stamp: "Formatted at 2026-09-28 13:05:32 on dist-test-slave-ddvw"
server_key: "6e6cd06738ab1c594fac77533d3b58da"
server_key_iv: "d9b1b3e33dc839913e5343ab6d5abbe0"
server_key_version: "encryptionkey@0"
I20260928 13:05:32.848989 16792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:32.877624 16792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:32.880162 16792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:32.880335 16792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:32.884502 16792 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:43569
I20260928 13:05:32.884554 16859 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:43569 every 8 connection(s)
I20260928 13:05:32.884943 16792 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:32.885939 16860 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:32.888239 16860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap starting.
I20260928 13:05:32.888763 16860 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:32.889014 16860 log.cc:824] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:32.889662 16860 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: No bootstrap required, opened a new log
I20260928 13:05:32.891345 16860 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:32.891486 16860 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:32.891508 16860 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Initialized, Role: FOLLOWER
I20260928 13:05:32.891647 16860 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:32.891726 16860 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:32.891748 16860 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:32.891775 16860 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:32.892520 16860 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:32.892606 16860 leader_election.cc:302] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ebb37a150714023bb82bd30e617cf54; no voters: 
I20260928 13:05:32.892724 16860 leader_election.cc:288] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:05:32.892786 16863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:32.893000 16863 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 LEADER]: Becoming Leader. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Running, Role: LEADER
I20260928 13:05:32.893018 16860 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:32.893139 16863 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:32.893525 16864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:32.893496 16865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ebb37a150714023bb82bd30e617cf54. Latest consensus state: current_term: 1 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:32.893610 16864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:32.893684 16865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:32.894287 16872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:32.894833 16872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:32.894964  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16792
I20260928 13:05:32.895102  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:05:32.895298  3096 external_mini_cluster.cc:1428] Setting key 4446fa4d1281367365865d79171172f0
I20260928 13:05:32.896554 16872 catalog_manager.cc:1347] Generated new cluster ID: 92a78cc44926449d819c968aa25531c5
I20260928 13:05:32.896605 16872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:05:32.902773 16872 catalog_manager.cc:1370] Generated new certificate authority record
Sep 28 13:05:32 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:32.903482 16872 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:32.907109 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:32.895768 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44104 (local address 127.3.6.62:43569)
0928 13:05:32.896151 (+   383us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:32.896160 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:32.896192 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:05:32.896301 (+   109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:32.896308 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:32.896374 (+    66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:32.896508 (+   134us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:32.897373 (+   865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:32.898840 (+  1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:32.899948 (+  1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:32.900540 (+   592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:32.900641 (+   101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:32.903577 (+  2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:32.903582 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:32.903582 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:32.903594 (+    12us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:32.905485 (+  1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:32.905886 (+   401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:32.905888 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:32.905889 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:32.905992 (+   103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:32.906206 (+   214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:32.906207 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:32.906208 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:32.906440 (+   232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:32.906615 (+   175us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:32.906683 (+    68us) server_negotiation.cc:299] Negotiation successful
0928 13:05:32.906835 (+   152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":61,"threads_started":1}
I20260928 13:05:32.915510 16872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Generated new TSK 0
I20260928 13:05:32.915752 16872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:05:32.949452  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:33.050741 16886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.050944 16886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.050969 16886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.052356 16886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.052402 16886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.052431 16886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:33.054046 16886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.054301 16886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.054575 16886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.059656 16891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.059655 16894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.059828 16886 server_base.cc:1034] running on GCE node
W20260928 13:05:33.059984 16892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.060225 16886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.060438 16886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.061587 16886 hybrid_clock.cc:648] HybridClock initialized: now 1790600733061574 us; error 30 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.064201 16886 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:33.064697 16886 webserver.cc:460] Webserver started at http://127.3.6.1:46449/ using document root <none> and password file <none>
I20260928 13:05:33.064925 16886 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.064968 16886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.065064 16886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:33.066089 16886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "0f16adb183fe4429bcb4758de31e1d99"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "ce64520ab6d1907336b701f7a7a9b85c"
server_key_iv: "66b5da3efb79466c6386c848a4983324"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.066385 16886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "0f16adb183fe4429bcb4758de31e1d99"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "ce64520ab6d1907336b701f7a7a9b85c"
server_key_iv: "66b5da3efb79466c6386c848a4983324"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.067742 16886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:05:33.068427 16901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.068643 16886 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:33.068734 16886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "0f16adb183fe4429bcb4758de31e1d99"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "ce64520ab6d1907336b701f7a7a9b85c"
server_key_iv: "66b5da3efb79466c6386c848a4983324"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.068822 16886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.080307 16886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.082453 16886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.082602 16886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.082852 16886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:33.083230 16886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:33.083287 16886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.083328 16886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:33.083354 16886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.089529 16886 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37879
I20260928 13:05:33.089571 17014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37879 every 8 connection(s)
I20260928 13:05:33.089893 16886 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:33.095229  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 16886
I20260928 13:05:33.095319  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:05:33.095513  3096 external_mini_cluster.cc:1428] Setting key e44e78209cfbba591c9d2bdd8d839276
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:33.100075 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.090641 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:58099 (local address 127.3.6.62:43569)
0928 13:05:33.090714 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.090717 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.090931 (+   214us) server_negotiation.cc:407] Connection header received
0928 13:05:33.091499 (+   568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.091500 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.091510 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.091564 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.092539 (+   975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.093040 (+   501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.094172 (+  1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.094374 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.094431 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.096859 (+  2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.096861 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.096862 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.096871 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.098440 (+  1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.098939 (+   499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.098940 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.098940 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.099047 (+   107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.099368 (+   321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.099369 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.099369 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.099478 (+   109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.099531 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.099889 (+   358us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.100006 (+   117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:05:33.100306 17017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.090621 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:58099)
0928 13:05:33.090809 (+   188us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.090846 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.091405 (+   559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.091619 (+   214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.091623 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.092195 (+   572us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.092459 (+   264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.092466 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.093122 (+   656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.093123 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.094098 (+   975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.094101 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.094440 (+   339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.094450 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.094554 (+   104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.095164 (+   610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.095172 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.096774 (+  1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.098531 (+  1757us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.098538 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.098540 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.098863 (+   323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.099111 (+   248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.099112 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.099112 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.099306 (+   194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.099548 (+   242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.099555 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.099730 (+   175us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.099855 (+   125us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.100045 (+   190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":105,"threads_started":1}
I20260928 13:05:33.101277 17015 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:33.101397 17015 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:33.101577 17015 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:33.102182 16824 ts_manager.cc:194] Registered new tserver with Master: 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1:37879)
I20260928 13:05:33.103183 16824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:58099
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:05:33.119787  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:33.201251 17020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.201452 17020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.201476 17020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.202548 17020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.202584 17020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.202608 17020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:33.203944 17020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.204118 17020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.204282 17020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.209087 17025 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.209244 17020 server_base.cc:1034] running on GCE node
W20260928 13:05:33.209056 17026 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.209057 17028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.209550 17020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.209795 17020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.210997 17020 hybrid_clock.cc:648] HybridClock initialized: now 1790600733210965 us; error 40 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.213598 17020 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:33.214071 17020 webserver.cc:460] Webserver started at http://127.3.6.2:33453/ using document root <none> and password file <none>
I20260928 13:05:33.214301 17020 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.214346 17020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.214497 17020 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:33.215626 17020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "c6d089cf71aa443688a69b5a767045f8"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "09c0981037de7e2a0d3038093047e9c4"
server_key_iv: "e7eb8f4b2f7f4abe820dfd19dc3033c3"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.216007 17020 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "c6d089cf71aa443688a69b5a767045f8"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "09c0981037de7e2a0d3038093047e9c4"
server_key_iv: "e7eb8f4b2f7f4abe820dfd19dc3033c3"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.217336 17020 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:05:33.218091 17035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.218282 17020 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:33.218372 17020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "c6d089cf71aa443688a69b5a767045f8"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "09c0981037de7e2a0d3038093047e9c4"
server_key_iv: "e7eb8f4b2f7f4abe820dfd19dc3033c3"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.218427 17020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.229791 17020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.231900 17020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.232033 17020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.232227 17020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:33.232558 17020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:33.232592 17020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.232638 17020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:33.232666 17020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.238507 17020 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42685
I20260928 13:05:33.238605 17148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42685 every 8 connection(s)
I20260928 13:05:33.238910 17020 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:33.244266  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17020
I20260928 13:05:33.244380  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:05:33.244580  3096 external_mini_cluster.cc:1428] Setting key 23eab23a1df45400271a12231a6dc3ee
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:33.248750 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.239719 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:52713 (local address 127.3.6.62:43569)
0928 13:05:33.239764 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.239766 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.240024 (+   258us) server_negotiation.cc:407] Connection header received
0928 13:05:33.240491 (+   467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.240492 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.240506 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.240565 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.241466 (+   901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.241960 (+   494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.242923 (+   963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.243182 (+   259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.243238 (+    56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.245778 (+  2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.245780 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.245780 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.245788 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.247295 (+  1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.247737 (+   442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.247738 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.247739 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.247800 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.248071 (+   271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.248072 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.248073 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.248193 (+   120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.248265 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.248570 (+   305us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.248657 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:05:33.248974 17151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.239673 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:52713)
0928 13:05:33.239842 (+   169us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.239884 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.240406 (+   522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.240620 (+   214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.240624 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.241190 (+   566us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.241381 (+   191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.241385 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.242047 (+   662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.242048 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.242850 (+   802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.242851 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.243273 (+   422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.243284 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.243396 (+   112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.243978 (+   582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.243986 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.245675 (+  1689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.247389 (+  1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.247397 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.247399 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.247656 (+   257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.247879 (+   223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.247879 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.247880 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.247996 (+   116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.248268 (+   272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.248275 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.248423 (+   148us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.248534 (+   111us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.248703 (+   169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260928 13:05:33.249549 17149 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:33.249670 17149 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:33.249850 17149 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:33.250257 16824 ts_manager.cc:194] Registered new tserver with Master: c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
I20260928 13:05:33.250653 16824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:52713
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:05:33.269869  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:33.351593 17154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.351804 17154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.351832 17154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.353099 17154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.353178 17154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.353205 17154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:33.354688 17154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.354938 17154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.355211 17154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.360137 17162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.360137 17159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.360176 17154 server_base.cc:1034] running on GCE node
W20260928 13:05:33.360241 17160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.360535 17154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.360782 17154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.361953 17154 hybrid_clock.cc:648] HybridClock initialized: now 1790600733361928 us; error 37 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.364482 17154 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:33.364934 17154 webserver.cc:460] Webserver started at http://127.3.6.3:38171/ using document root <none> and password file <none>
I20260928 13:05:33.365177 17154 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.365245 17154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.365396 17154 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:33.366454 17154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "70d2e49eaebbec12e690df9fea3bf171"
server_key_iv: "52b440ff76acd81d1297c9e124dc2b39"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.366807 17154 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "70d2e49eaebbec12e690df9fea3bf171"
server_key_iv: "52b440ff76acd81d1297c9e124dc2b39"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.368217 17154 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:33.368993 17169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.369171 17154 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:33.369270 17154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "70d2e49eaebbec12e690df9fea3bf171"
server_key_iv: "52b440ff76acd81d1297c9e124dc2b39"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.369364 17154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.379911 17154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.381867 17154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.382030 17154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.382261 17154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:33.382570 17154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:33.382624 17154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.382658 17154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:33.382688 17154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.388538 17154 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:42559
I20260928 13:05:33.388582 17282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:42559 every 8 connection(s)
I20260928 13:05:33.388909 17154 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:33.395126  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17154
I20260928 13:05:33.395233  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:05:33.395398  3096 external_mini_cluster.cc:1428] Setting key 5af8ceb48491c638ccbaf5b5c011db5b
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:33.398990 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.389626 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:37445 (local address 127.3.6.62:43569)
0928 13:05:33.389691 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.389694 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.389889 (+   195us) server_negotiation.cc:407] Connection header received
0928 13:05:33.390371 (+   482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.390371 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.390382 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.390440 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.391455 (+  1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.392041 (+   586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.393049 (+  1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.393327 (+   278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.393413 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.396180 (+  2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.396182 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.396183 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.396190 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.397620 (+  1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.398040 (+   420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.398042 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.398042 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.398103 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.398356 (+   253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.398357 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.398357 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.398470 (+   113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.398543 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.398819 (+   276us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.398894 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 13:05:33.399210 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.389595 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:37445)
0928 13:05:33.389758 (+   163us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.389799 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.390275 (+   476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.390494 (+   219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.390497 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.391135 (+   638us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.391328 (+   193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.391333 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.392135 (+   802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.392136 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.392966 (+   830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.392969 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.393447 (+   478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.393458 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.393603 (+   145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.394354 (+   751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.394363 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.396069 (+  1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.397724 (+  1655us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.397731 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.397733 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.397962 (+   229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.398171 (+   209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.398172 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.398172 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.398284 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.398548 (+   264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.398554 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.398688 (+   134us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.398802 (+   114us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.398960 (+   158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
I20260928 13:05:33.399716 17283 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:33.399822 17283 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:33.400013 17283 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:33.400348 16824 ts_manager.cc:194] Registered new tserver with Master: ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559)
I20260928 13:05:33.400682 16824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:37445
I20260928 13:05:33.407176  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:05:33.414270 16882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.408520 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48046 (local address 127.3.6.62:43569)
0928 13:05:33.408578 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.408580 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.408722 (+   142us) server_negotiation.cc:407] Connection header received
0928 13:05:33.408763 (+    41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.408764 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.408771 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.408864 (+    93us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.409360 (+   496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.409843 (+   483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.410526 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.410709 (+   183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.410763 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.411899 (+  1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.411900 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.411900 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.411906 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.413312 (+  1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.413632 (+   320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.413633 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.413634 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.413694 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.413848 (+   154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.413855 (+     7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.413855 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.413999 (+   144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.414077 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.414145 (+    68us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.414207 (+    62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 13:05:33.416175 16824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48046:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:05:33.417721 16824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:05:33.424641 17298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420279 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47842 (local address 127.3.6.2:42685)
0928 13:05:33.420449 (+   170us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.420454 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.420510 (+    56us) server_negotiation.cc:407] Connection header received
0928 13:05:33.420606 (+    96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.420608 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.420630 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.420690 (+    60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:33.420926 (+   236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422112 (+  1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.423525 (+  1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.424229 (+   704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.424309 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.424368 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.424502 (+   134us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.424547 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260928 13:05:33.424662 17294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420015 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42685 (local address 127.0.0.1:47842)
0928 13:05:33.420434 (+   419us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.420446 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.420525 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.420748 (+   223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.420752 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.420755 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:33.420829 (+    74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.420831 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422235 (+  1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.422236 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.423418 (+  1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.423421 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.424316 (+   895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.424317 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.424397 (+    80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.424409 (+    12us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.424471 (+    62us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.424552 (+    81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":39,"thread_start_us":91,"threads_started":1}
I20260928 13:05:33.424862 17299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420467 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36716 (local address 127.3.6.3:42559)
0928 13:05:33.420829 (+   362us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.420833 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.420843 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:05:33.420892 (+    49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.420894 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.420909 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.420993 (+    84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:33.421212 (+   219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422017 (+   805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.423724 (+  1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.424430 (+   706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.424511 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.424562 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.424709 (+   147us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.424762 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":84,"threads_started":1}
I20260928 13:05:33.425060 17296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420223 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:42559 (local address 127.0.0.1:36716)
0928 13:05:33.420452 (+   229us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.420462 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.420521 (+    59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.421072 (+   551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.421073 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.421075 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:33.421131 (+    56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.421137 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422127 (+   990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.422129 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.423635 (+  1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.423638 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.424524 (+   886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.424524 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.424573 (+    49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.424577 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.424628 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.424662 (+    34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":99,"thread_start_us":64,"threads_started":1}
I20260928 13:05:33.425657 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420006 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37879 (local address 127.0.0.1:48696)
0928 13:05:33.420157 (+   151us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.420204 (+    47us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.420270 (+    66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.420884 (+   614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.420885 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.420887 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:33.420921 (+    34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.420922 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422291 (+  1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.422291 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.423635 (+  1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.423638 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.425429 (+  1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.425430 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.425492 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.425496 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.425550 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.425592 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":6,"thread_start_us":61,"threads_started":1}
I20260928 13:05:33.425724 17083 tablet_service.cc:1467] Processing CreateTablet for tablet ba8501d85a614b6084905ae36601cba0 (DEFAULT_TABLE table=test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:33.425925 17297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.420229 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48696 (local address 127.3.6.1:37879)
0928 13:05:33.420711 (+   482us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.420717 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.420727 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:05:33.420763 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.420765 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.420779 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.421010 (+   231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:33.421082 (+    72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.422200 (+  1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.424599 (+  2399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.425356 (+   757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.425428 (+    72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.425490 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.425789 (+   299us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.425839 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":109,"threads_started":1}
I20260928 13:05:33.425876 17217 tablet_service.cc:1467] Processing CreateTablet for tablet ba8501d85a614b6084905ae36601cba0 (DEFAULT_TABLE table=test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:33.426118 17083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8501d85a614b6084905ae36601cba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:33.426136 17217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8501d85a614b6084905ae36601cba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:33.429577 17301 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Bootstrap starting.
I20260928 13:05:33.430295 17301 tablet_bootstrap.cc:654] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:33.430186 16949 tablet_service.cc:1467] Processing CreateTablet for tablet ba8501d85a614b6084905ae36601cba0 (DEFAULT_TABLE table=test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:33.430562 16949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba8501d85a614b6084905ae36601cba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:33.430918 17301 log.cc:824] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:33.431360 17300 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Bootstrap starting.
I20260928 13:05:33.431779 17301 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: No bootstrap required, opened a new log
I20260928 13:05:33.431867 17301 ts_tablet_manager.cc:1397] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:05:33.432090 17300 tablet_bootstrap.cc:654] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:33.432711 17300 log.cc:824] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:33.433559 17300 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: No bootstrap required, opened a new log
I20260928 13:05:33.433637 17300 ts_tablet_manager.cc:1397] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:33.433557 17301 raft_consensus.cc:348] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.433750 17301 raft_consensus.cc:374] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:33.433813 17301 raft_consensus.cc:729] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc75970cc164e0d82dbd37e54fd88cb, State: Initialized, Role: FOLLOWER
I20260928 13:05:33.433943 17301 consensus_queue.cc:260] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.434252 17283 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
I20260928 13:05:33.434252 17301 ts_tablet_manager.cc:1428] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:05:33.435186 17304 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap starting.
I20260928 13:05:33.435532 17300 raft_consensus.cc:348] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.435695 17300 raft_consensus.cc:374] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:33.435771 17300 raft_consensus.cc:729] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d089cf71aa443688a69b5a767045f8, State: Initialized, Role: FOLLOWER
I20260928 13:05:33.435892 17304 tablet_bootstrap.cc:654] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:33.435927 17300 consensus_queue.cc:260] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.436249 17300 ts_tablet_manager.cc:1428] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20260928 13:05:33.436280 17149 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
I20260928 13:05:33.436602 17304 log.cc:824] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:33.437453 17304 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: No bootstrap required, opened a new log
I20260928 13:05:33.437517 17304 ts_tablet_manager.cc:1397] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:33.438817 17304 raft_consensus.cc:348] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.438947 17304 raft_consensus.cc:374] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:33.438977 17304 raft_consensus.cc:729] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Initialized, Role: FOLLOWER
I20260928 13:05:33.439121 17304 consensus_queue.cc:260] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.439368 17304 ts_tablet_manager.cc:1428] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:33.439430 17015 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
I20260928 13:05:33.441380 17308 raft_consensus.cc:482] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:33.441479 17308 raft_consensus.cc:504] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.441771 17308 leader_election.cc:288] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685), ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559)
I20260928 13:05:33.444599 17298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.442016 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:48361 (local address 127.3.6.2:42685)
0928 13:05:33.442107 (+    91us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.442109 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.442118 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:05:33.442143 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.442144 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.442155 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.442237 (+    82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:33.442397 (+   160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.442871 (+   474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.443835 (+   964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.444219 (+   384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.444313 (+    94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.444323 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.444498 (+   175us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.444536 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260928 13:05:33.444599 17017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.441929 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42685 (local address 127.3.6.1:48361)
0928 13:05:33.441979 (+    50us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.441990 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.442031 (+    41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.442242 (+   211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.442243 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.442245 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:33.442308 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.442309 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.442961 (+   652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.442962 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.443742 (+   780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.443744 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.444314 (+   570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.444315 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.444406 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.444410 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.444489 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.444534 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260928 13:05:33.444860 17309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.442062 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:42559 (local address 127.3.6.1:52155)
0928 13:05:33.442239 (+   177us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.442255 (+    16us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.442335 (+    80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.442478 (+   143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.442479 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.442480 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:33.442547 (+    67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.442548 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.443274 (+   726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.443275 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.444023 (+   748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.444025 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.444597 (+   572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.444597 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.444674 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.444679 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.444738 (+    59us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.444782 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":99,"threads_started":1}
I20260928 13:05:33.444886 17299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.442121 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:52155 (local address 127.3.6.3:42559)
0928 13:05:33.442191 (+    70us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.442193 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.442324 (+   131us) server_negotiation.cc:407] Connection header received
0928 13:05:33.442392 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.442393 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.442405 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.442476 (+    71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:33.442666 (+   190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.443196 (+   530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.444117 (+   921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.444500 (+   383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.444592 (+    92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.444602 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.444760 (+   158us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.444821 (+    61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:05:33.444941 17103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8501d85a614b6084905ae36601cba0" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d089cf71aa443688a69b5a767045f8" is_pre_election: true
I20260928 13:05:33.445103 17103 raft_consensus.cc:2454] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 0.
I20260928 13:05:33.445317 16904 leader_election.cc:302] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99, c6d089cf71aa443688a69b5a767045f8; no voters: 
I20260928 13:05:33.445429 17308 raft_consensus.cc:2781] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:05:33.445398 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8501d85a614b6084905ae36601cba0" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" is_pre_election: true
I20260928 13:05:33.445484 17308 raft_consensus.cc:482] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:05:33.445537 17308 raft_consensus.cc:3037] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:33.445538 17237 raft_consensus.cc:2454] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 0.
I20260928 13:05:33.446256 17308 raft_consensus.cc:504] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.446386 17308 leader_election.cc:288] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 election: Requested vote from peers c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685), ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559)
I20260928 13:05:33.446579 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8501d85a614b6084905ae36601cba0" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
I20260928 13:05:33.446581 17103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba8501d85a614b6084905ae36601cba0" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d089cf71aa443688a69b5a767045f8"
I20260928 13:05:33.446663 17103 raft_consensus.cc:3037] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:33.446663 17237 raft_consensus.cc:3037] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:33.447625 17103 raft_consensus.cc:2454] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 1.
I20260928 13:05:33.447625 17237 raft_consensus.cc:2454] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 1.
I20260928 13:05:33.447803 16904 leader_election.cc:302] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99, c6d089cf71aa443688a69b5a767045f8; no voters: 
I20260928 13:05:33.447907 17308 raft_consensus.cc:2781] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:33.448053 17308 raft_consensus.cc:686] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 LEADER]: Becoming Leader. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Running, Role: LEADER
I20260928 13:05:33.448122 17308 consensus_queue.cc:237] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.449061 16824 catalog_manager.cc:5495] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "0f16adb183fe4429bcb4758de31e1d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } health_report { overall_health: UNKNOWN } } }
I20260928 13:05:33.459996 17297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.457618 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48704 (local address 127.3.6.1:37879)
0928 13:05:33.457674 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.457676 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.457685 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:05:33.457728 (+    43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.457729 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.457749 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.457811 (+    62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:05:33.457970 (+   159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.458431 (+   461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.459244 (+   813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.459442 (+   198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.459505 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.459635 (+   130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:05:33.459736 (+   101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:05:33.459798 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.459872 (+    74us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.459890 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 13:05:33.462080 17237 raft_consensus.cc:1261] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Refusing update from remote peer 0f16adb183fe4429bcb4758de31e1d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:33.462168 17103 raft_consensus.cc:1261] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Refusing update from remote peer 0f16adb183fe4429bcb4758de31e1d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:33.462424 17308 consensus_queue.cc:1035] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:33.462664 17310 consensus_queue.cc:1035] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:33.464967 17313 mvcc.cc:205] Tried to move back new op lower bound from 7334300604257308672 to 7334300604204142592. Current Snapshot: MvccSnapshot[applied={T|T < 7334300604257308672}]
I20260928 13:05:33.465090 17314 mvcc.cc:205] Tried to move back new op lower bound from 7334300604257308672 to 7334300604204142592. Current Snapshot: MvccSnapshot[applied={T|T < 7334300604257308672}]
I20260928 13:05:33.466285 17315 mvcc.cc:205] Tried to move back new op lower bound from 7334300604257308672 to 7334300604204142592. Current Snapshot: MvccSnapshot[applied={T|T < 7334300604257308672}]
I20260928 13:05:33.467344 16823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:33.467450 16823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:33.468258 16823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Sending DeleteTablet for 3 replicas of tablet ba8501d85a614b6084905ae36601cba0
I20260928 13:05:33.468547 16949 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8501d85a614b6084905ae36601cba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:33 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:48696
I20260928 13:05:33.468580 17083 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8501d85a614b6084905ae36601cba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:33 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:47842
I20260928 13:05:33.468626 17217 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8501d85a614b6084905ae36601cba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:33 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36716
I20260928 13:05:33.468743  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16886
I20260928 13:05:33.469348 17324 tablet_replica.cc:330] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: stopping tablet replica
I20260928 13:05:33.469483 17324 raft_consensus.cc:2229] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:33.469604 17324 raft_consensus.cc:2258] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:33.470100 17324 ts_tablet_manager.cc:1905] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:33.470901 17322 tablet_replica.cc:330] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: stopping tablet replica
I20260928 13:05:33.471042 17322 raft_consensus.cc:2229] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:33.471159 17322 raft_consensus.cc:2258] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:33.471714 17322 ts_tablet_manager.cc:1905] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:33.472214 17324 ts_tablet_manager.cc:1918] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:33.472283 17324 log.cc:1196] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/ba8501d85a614b6084905ae36601cba0
I20260928 13:05:33.472625 17324 ts_tablet_manager.cc:1939] T ba8501d85a614b6084905ae36601cba0 P ffc75970cc164e0d82dbd37e54fd88cb: Deleting consensus metadata
I20260928 13:05:33.473274 16810 catalog_manager.cc:4841] TS ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): tablet ba8501d85a614b6084905ae36601cba0 (table test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]) successfully deleted
I20260928 13:05:33.473620 17322 ts_tablet_manager.cc:1918] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:33.473681 17322 log.cc:1196] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/ba8501d85a614b6084905ae36601cba0
I20260928 13:05:33.473872 17322 ts_tablet_manager.cc:1939] T ba8501d85a614b6084905ae36601cba0 P c6d089cf71aa443688a69b5a767045f8: Deleting consensus metadata
I20260928 13:05:33.474613 16810 catalog_manager.cc:4841] TS c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): tablet ba8501d85a614b6084905ae36601cba0 (table test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]) successfully deleted
W20260928 13:05:33.476322 16811 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:37879 (error 108)
I20260928 13:05:33.476563  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17020
I20260928 13:05:33.477572 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.477430 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37879 (local address 127.0.0.1:48708)
0928 13:05:33.477496 (+    66us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.477534 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260928 13:05:33.477725 16811 catalog_manager.cc:4584] TS 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1:37879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba8501d85a614b6084905ae36601cba0: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37879: connect: Connection refused (error 111)
I20260928 13:05:33.481424  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17154
I20260928 13:05:33.486047  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 16792
I20260928 13:05:33.491500  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--webserver_interface=127.3.6.62
--webserver_port=41561
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:33.572604 17326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.572806 17326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.572829 17326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.573907 17326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:33.573941 17326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.573956 17326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.573967 17326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:33.573979 17326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:33.575394 17326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=41561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.575600 17326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.575855 17326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.584421 17332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.584437 17333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.584419 17335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.584725 17326 server_base.cc:1034] running on GCE node
I20260928 13:05:33.585026 17326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.585368 17326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.586540 17326 hybrid_clock.cc:648] HybridClock initialized: now 1790600733586520 us; error 38 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.589205 17326 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:33.589730 17326 webserver.cc:460] Webserver started at http://127.3.6.62:41561/ using document root <none> and password file <none>
I20260928 13:05:33.589990 17326 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.590082 17326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.591588 17326 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:05:33.592258 17342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.592429 17326 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:33.592553 17326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "9ebb37a150714023bb82bd30e617cf54"
format_stamp: "Formatted at 2026-09-28 13:05:32 on dist-test-slave-ddvw"
server_key: "6e6cd06738ab1c594fac77533d3b58da"
server_key_iv: "d9b1b3e33dc839913e5343ab6d5abbe0"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.592965 17326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.612141 17326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.614246 17326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.614418 17326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.618780 17326 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:43569
I20260928 13:05:33.618818 17394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:43569 every 8 connection(s)
I20260928 13:05:33.619280 17326 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:33.621037 17395 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:05:33.621647 17395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap starting.
I20260928 13:05:33.626698  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17326
I20260928 13:05:33.627059  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:37879
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=46449
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:33.629952 17395 log.cc:824] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:33.632112 17395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:05:33.632432 17395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap complete.
I20260928 13:05:33.634739 17395 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:33.635010 17395 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Initialized, Role: FOLLOWER
I20260928 13:05:33.635223 17395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:33.635309 17395 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:33.635376 17395 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:33.635428 17395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:05:33.636440 17395 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:33.636560 17395 leader_election.cc:302] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ebb37a150714023bb82bd30e617cf54; no voters: 
I20260928 13:05:33.636770 17395 leader_election.cc:288] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260928 13:05:33.636811 17399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 13:05:33.636965 17399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 LEADER]: Becoming Leader. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Running, Role: LEADER
I20260928 13:05:33.637042 17395 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:33.637122 17399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:33.637384 17399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ebb37a150714023bb82bd30e617cf54. Latest consensus state: current_term: 2 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:33.637389 17400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:33.637470 17399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:33.637503 17400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:33.639039 17415 catalog_manager.cc:1259] Loaded cluster ID: 92a78cc44926449d819c968aa25531c5
I20260928 13:05:33.639086 17415 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: loading cluster ID for follower catalog manager: success
W20260928 13:05:33.639284 17415 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260928 13:05:33.639324 17415 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260928 13:05:33.639479 17405 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:33.639829 17405 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:33.639905 17405 catalog_manager.cc:1259] Loaded cluster ID: 92a78cc44926449d819c968aa25531c5
I20260928 13:05:33.639936 17405 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:05:33.640081 17405 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260928 13:05:33.644744 17405 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260928 13:05:33.647214 17405 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:33.647418 17405 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Loaded TSK: 0
I20260928 13:05:33.647635 17405 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 13:05:33.710175 17397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.710435 17397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.710489 17397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.711903 17397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.711980 17397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.712030 17397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:33.713586 17397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:37879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=46449
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.713860 17397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.714100 17397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.720247 17425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.720247 17423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.720556 17397 server_base.cc:1034] running on GCE node
W20260928 13:05:33.720249 17422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.720860 17397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.721159 17397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.722316 17397 hybrid_clock.cc:648] HybridClock initialized: now 1790600733722287 us; error 46 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.725158 17397 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:33.725736 17397 webserver.cc:460] Webserver started at http://127.3.6.1:46449/ using document root <none> and password file <none>
I20260928 13:05:33.726032 17397 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.726116 17397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.727936 17397 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:33.728739 17432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.728965 17397 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:33.729060 17397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "0f16adb183fe4429bcb4758de31e1d99"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "ce64520ab6d1907336b701f7a7a9b85c"
server_key_iv: "66b5da3efb79466c6386c848a4983324"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.729553 17397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.762538 17397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.765012 17397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.765161 17397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.765421 17397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:33.765898 17439 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 13:05:33.767465 17397 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 13:05:33.767529 17397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260928 13:05:33.767563 17397 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 13:05:33.768443 17397 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 13:05:33.768488 17397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:33.768576 17439 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap starting.
I20260928 13:05:33.775830 17397 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37879
I20260928 13:05:33.776240 17397 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:33.779114 17439 log.cc:824] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:33.779230 17546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37879 every 8 connection(s)
I20260928 13:05:33.781956 17439 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:05:33.782298 17439 tablet_bootstrap.cc:492] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap complete.
I20260928 13:05:33.782363  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17397
I20260928 13:05:33.782632  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:42685
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=33453
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:33.783533 17439 ts_tablet_manager.cc:1397] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.006s
I20260928 13:05:33.785197 17439 raft_consensus.cc:348] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.785593 17439 raft_consensus.cc:729] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Initialized, Role: FOLLOWER
I20260928 13:05:33.785749 17439 consensus_queue.cc:260] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } }
I20260928 13:05:33.786018 17439 ts_tablet_manager.cc:1428] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.002s
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:33.790992 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.780216 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51461 (local address 127.3.6.62:43569)
0928 13:05:33.780408 (+   192us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.780417 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.780456 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:05:33.781164 (+   708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.781171 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.781226 (+    55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.781366 (+   140us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.782213 (+   847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.783745 (+  1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.784744 (+   999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.785143 (+   399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.785263 (+   120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.787583 (+  2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.787587 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.787588 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.787599 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.789266 (+  1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.789702 (+   436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.789705 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.789711 (+     6us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.789804 (+    93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.790085 (+   281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.790086 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.790087 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.790303 (+   216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.790404 (+   101us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.790694 (+   290us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.790815 (+   121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
I20260928 13:05:33.790992 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.779895 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:51461)
0928 13:05:33.780077 (+   182us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.780125 (+    48us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.780943 (+   818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.781421 (+   478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.781426 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.781771 (+   345us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.782074 (+   303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.782080 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.783844 (+  1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.783846 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.784639 (+   793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.784641 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.785228 (+   587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.785239 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.785375 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.785979 (+   604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.785989 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.787480 (+  1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.789377 (+  1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.789384 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.789386 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.789615 (+   229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.789875 (+   260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.789876 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.789876 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.790029 (+   153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.790376 (+   347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.790382 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.790523 (+   141us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.790629 (+   106us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.790800 (+   171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":80,"threads_started":1}
I20260928 13:05:33.791692 17547 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:33.791803 17547 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:33.791987 17547 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:33.792749 17359 ts_manager.cc:194] Registered new tserver with Master: 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1:37879)
I20260928 13:05:33.793776 17359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:51461
I20260928 13:05:33.794728 17547 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:05:33.801887 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.793386 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48714 (local address 127.3.6.1:37879)
0928 13:05:33.793794 (+   408us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.793798 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.793807 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:05:33.793837 (+    30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.793838 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.793851 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.793907 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.794407 (+   500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.795399 (+   992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.796496 (+  1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.796927 (+   431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.796984 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.798997 (+  2013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.799037 (+    40us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.799037 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.799044 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.800590 (+  1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.801008 (+   418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.801011 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.801011 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.801070 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.801285 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.801286 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.801287 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.801428 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.801521 (+    93us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.801706 (+   185us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.801794 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":85,"threads_started":1}
I20260928 13:05:33.801898 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.793338 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37879 (local address 127.0.0.1:48714)
0928 13:05:33.793573 (+   235us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.793612 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.793681 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.793961 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.793965 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.794271 (+   306us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.794326 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.794327 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.795469 (+  1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.795470 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.796396 (+   926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.796399 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.796995 (+   596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.796999 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.797076 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.797512 (+   436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.797517 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.798891 (+  1374us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.800696 (+  1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.800702 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.800704 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.800911 (+   207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.801148 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.801148 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.801149 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.801213 (+    64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.801512 (+   299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.801517 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.801570 (+    53us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.801671 (+   101us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.801790 (+   119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":84,"threads_started":1}
I20260928 13:05:33.802354 17481 tablet_service.cc:1514] Processing DeleteTablet for tablet ba8501d85a614b6084905ae36601cba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:33 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:48714
I20260928 13:05:33.802948 17556 tablet_replica.cc:330] stopping tablet replica
I20260928 13:05:33.803066 17556 raft_consensus.cc:2229] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:33.803130 17556 raft_consensus.cc:2258] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:33.803464 17556 ts_tablet_manager.cc:1905] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:33.805784 17556 ts_tablet_manager.cc:1918] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:33.805856 17556 log.cc:1196] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/ba8501d85a614b6084905ae36601cba0
I20260928 13:05:33.806071 17556 ts_tablet_manager.cc:1939] T ba8501d85a614b6084905ae36601cba0 P 0f16adb183fe4429bcb4758de31e1d99: Deleting consensus metadata
I20260928 13:05:33.806546 17346 catalog_manager.cc:4841] TS 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1:37879): tablet ba8501d85a614b6084905ae36601cba0 (table test-table [id=bbcce13d83354463b4bd4304cdd9b8cd]) successfully deleted
W20260928 13:05:33.868644 17552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:33.868870 17552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:33.868896 17552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:33.870123 17552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:33.870182 17552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:33.870210 17552 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:33.871729 17552 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:42685
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=33453
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:33.872000 17552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:33.872246 17552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:33.877236 17562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.877236 17564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:33.877429 17561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:33.877525 17552 server_base.cc:1034] running on GCE node
I20260928 13:05:33.877851 17552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:33.878119 17552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:33.879289 17552 hybrid_clock.cc:648] HybridClock initialized: now 1790600733879191 us; error 126 us; skew 500 ppm
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:33.882164 17552 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:33.882653 17552 webserver.cc:460] Webserver started at http://127.3.6.2:33453/ using document root <none> and password file <none>
I20260928 13:05:33.882918 17552 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:33.883008 17552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:33.884759 17552 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:05:33.885411 17571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.885596 17552 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:05:33.885699 17552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "c6d089cf71aa443688a69b5a767045f8"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "09c0981037de7e2a0d3038093047e9c4"
server_key_iv: "e7eb8f4b2f7f4abe820dfd19dc3033c3"
server_key_version: "encryptionkey@0"
I20260928 13:05:33.886077 17552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:33.901816 17552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:33.904408 17552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:33.904582 17552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:33.904817 17552 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:33.905129 17552 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:33.905187 17552 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.905231 17552 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:33.905263 17552 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:33.911761 17552 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42685
I20260928 13:05:33.911800 17684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42685 every 8 connection(s)
I20260928 13:05:33.912169 17552 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:33.918479  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17552
I20260928 13:05:33.918787  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:42559
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=38171
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:05:33 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600733, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:33.923149 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.912963 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:45381 (local address 127.3.6.62:43569)
0928 13:05:33.913007 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:33.913010 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:33.913263 (+   253us) server_negotiation.cc:407] Connection header received
0928 13:05:33.913849 (+   586us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:33.913851 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:33.913868 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:33.913927 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:33.914981 (+  1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.915585 (+   604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.916757 (+  1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.917008 (+   251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.917087 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.919655 (+  2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:33.919657 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:33.919657 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:33.919665 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:33.921397 (+  1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.921995 (+   598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.921995 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.921996 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.922049 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:33.922377 (+   328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:33.922378 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:33.922378 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:33.922484 (+   106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:33.922533 (+    49us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:33.922909 (+   376us) server_negotiation.cc:299] Negotiation successful
0928 13:05:33.923053 (+   144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:05:33.923470 17687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:33.912966 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:45381)
0928 13:05:33.913130 (+   164us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:33.913168 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:33.913726 (+   558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:33.914003 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:33.914008 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:33.914630 (+   622us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:33.914851 (+   221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.914857 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.915693 (+   836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.915694 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.916637 (+   943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:33.916639 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:33.917097 (+   458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:33.917111 (+    14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:33.917246 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:33.917845 (+   599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:33.917854 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:33.919533 (+  1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:33.921523 (+  1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.921530 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.921533 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.921893 (+   360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.922120 (+   227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:33.922121 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:33.922122 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:33.922287 (+   165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:33.922552 (+   265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:33.922559 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:33.922760 (+   201us) client_negotiation.cc:769] Sending connection context
0928 13:05:33.922895 (+   135us) client_negotiation.cc:240] Negotiation successful
0928 13:05:33.923140 (+   245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260928 13:05:33.924077 17685 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:33.924190 17685 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:33.924387 17685 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:33.924844 17359 ts_manager.cc:194] Registered new tserver with Master: c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
I20260928 13:05:33.925223 17359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:45381
W20260928 13:05:34.007336 17688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:34.007632 17688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:34.007656 17688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:34.008924 17688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:34.008965 17688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:34.008993 17688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:34.010459 17688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:42559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=38171
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:34.010694 17688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:34.010954 17688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:34.016850 17696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.016850 17693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.016896 17694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:34.017158 17688 server_base.cc:1034] running on GCE node
I20260928 13:05:34.017392 17688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:34.017663 17688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:34.018846 17688 hybrid_clock.cc:648] HybridClock initialized: now 1790600734018839 us; error 40 us; skew 500 ppm
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:34.021750 17688 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:34.022356 17688 webserver.cc:460] Webserver started at http://127.3.6.3:38171/ using document root <none> and password file <none>
I20260928 13:05:34.022650 17688 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:34.022735 17688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:34.024322 17688 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.024984 17703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.025194 17688 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.025293 17688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "70d2e49eaebbec12e690df9fea3bf171"
server_key_iv: "52b440ff76acd81d1297c9e124dc2b39"
server_key_version: "encryptionkey@0"
I20260928 13:05:34.025676 17688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:34.049230 17688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:34.051486 17688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:34.051659 17688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:34.051921 17688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:34.052263 17688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:34.052321 17688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.052368 17688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:34.052400 17688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.058725 17688 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:42559
I20260928 13:05:34.058781 17816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:42559 every 8 connection(s)
I20260928 13:05:34.059252 17688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:34.065078  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17688
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:34.069212 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.060090 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:32809 (local address 127.3.6.62:43569)
0928 13:05:34.060176 (+    86us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.060179 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.060357 (+   178us) server_negotiation.cc:407] Connection header received
0928 13:05:34.060823 (+   466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.060824 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.060833 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.060881 (+    48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:34.061778 (+   897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.062318 (+   540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.063376 (+  1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.063575 (+   199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.063634 (+    59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.066006 (+  2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:34.066008 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:34.066008 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:34.066015 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:34.067611 (+  1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:34.068076 (+   465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:34.068077 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:34.068078 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:34.068133 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:34.068425 (+   292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:34.068426 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:34.068427 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:34.068559 (+   132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:34.068638 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.068999 (+   361us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.069093 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 13:05:34.069372 17819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.060031 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:32809)
0928 13:05:34.060224 (+   193us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.060265 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.060739 (+   474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.060939 (+   200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:34.060943 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:34.061510 (+   567us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:34.061700 (+   190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.061704 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.062404 (+   700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.062405 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.063293 (+   888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.063295 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.063639 (+   344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.063648 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.063742 (+    94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.064328 (+   586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:34.064336 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:34.065895 (+  1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:34.067687 (+  1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:34.067693 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:34.067695 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:34.067987 (+   292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:34.068203 (+   216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:34.068204 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:34.068204 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:34.068352 (+   148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:34.068651 (+   299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:34.068657 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:34.068832 (+   175us) client_negotiation.cc:769] Sending connection context
0928 13:05:34.068957 (+   125us) client_negotiation.cc:240] Negotiation successful
0928 13:05:34.069081 (+   124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
I20260928 13:05:34.069985 17817 heartbeater.cc:347] Connected to a master server at 127.3.6.62:43569
I20260928 13:05:34.070091 17817 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:34.070278 17817 heartbeater.cc:511] Master 127.3.6.62:43569 requested a full tablet report, sending...
I20260928 13:05:34.070714 17359 ts_manager.cc:194] Registered new tserver with Master: ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559)
I20260928 13:05:34.071269 17359 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:32809
I20260928 13:05:34.072770 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.065476 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48060 (local address 127.3.6.62:43569)
0928 13:05:34.065606 (+   130us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.065608 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.065637 (+    29us) server_negotiation.cc:407] Connection header received
0928 13:05:34.065740 (+   103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.065741 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.065753 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.065812 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:34.066451 (+   639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.067338 (+   887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.068299 (+   961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.068589 (+   290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.068652 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.070106 (+  1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:34.070108 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:34.070108 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:34.070115 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:34.071734 (+  1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:34.072174 (+   440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:34.072175 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:34.072175 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:34.072225 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:34.072369 (+   144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:34.072370 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:34.072370 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:34.072462 (+    92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:34.072580 (+   118us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.072607 (+    27us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.072665 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260928 13:05:34.073510  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:05:34.076428 17821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.073883 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48066 (local address 127.3.6.62:43569)
0928 13:05:34.073937 (+    54us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.073939 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.074045 (+   106us) server_negotiation.cc:407] Connection header received
0928 13:05:34.074134 (+    89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.074135 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.074173 (+    38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.074263 (+    90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:05:34.074377 (+   114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.074829 (+   452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.075666 (+   837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.075872 (+   206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.075955 (+    83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.076118 (+   163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:05:34.076211 (+    93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:05:34.076312 (+   101us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.076335 (+    23us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.076356 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:05:34.076687 17359 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:48066:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:05:34.078219 17359 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:05:34.080431 17481 tablet_service.cc:1467] Processing CreateTablet for tablet d09f873a164548b8bbe99bacc5b89c8f (DEFAULT_TABLE table=test-table [id=11ef171f8c8e4d33b88377c0d104b783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:34.080646 17481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f873a164548b8bbe99bacc5b89c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:34.082178 17439 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap starting.
I20260928 13:05:34.082494 17439 tablet_bootstrap.cc:654] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:34.083032 17439 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: No bootstrap required, opened a new log
I20260928 13:05:34.083086 17439 ts_tablet_manager.cc:1397] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Time spent bootstrapping tablet: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:34.083433 17439 raft_consensus.cc:348] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.083516 17439 raft_consensus.cc:374] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:34.083562 17439 raft_consensus.cc:729] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Initialized, Role: FOLLOWER
I20260928 13:05:34.083604 17439 consensus_queue.cc:260] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.083683 17439 ts_tablet_manager.cc:1428] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.083683 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.080060 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:42559 (local address 127.0.0.1:36718)
0928 13:05:34.080111 (+    51us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.080122 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.080158 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.080565 (+   407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:34.080566 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:34.080568 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:34.080615 (+    47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.080617 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.081593 (+   976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.081594 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.082460 (+   866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.082473 (+    13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.083413 (+   940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.083414 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.083489 (+    75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.083507 (+    18us) client_negotiation.cc:769] Sending connection context
0928 13:05:34.083561 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:05:34.083604 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260928 13:05:34.083917 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.080144 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36718 (local address 127.3.6.3:42559)
0928 13:05:34.080373 (+   229us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.080378 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.080389 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:05:34.080428 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.080430 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.080447 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.080689 (+   242us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:34.080755 (+    66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.081488 (+   733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.082581 (+  1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.083307 (+   726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.083411 (+   104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.083470 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.083785 (+   315us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.083824 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":115,"threads_started":1}
I20260928 13:05:34.084404 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.080187 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42685 (local address 127.0.0.1:47846)
0928 13:05:34.080560 (+   373us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.080570 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.080620 (+    50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.080801 (+   181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:34.080802 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:34.080804 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:34.080838 (+    34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.080839 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.082056 (+  1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.082058 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.083172 (+  1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.083174 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.084168 (+   994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.084169 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.084234 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.084237 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:05:34.084294 (+    57us) client_negotiation.cc:240] Negotiation successful
0928 13:05:34.084335 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":97,"threads_started":1}
I20260928 13:05:34.084419 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.080353 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47846 (local address 127.3.6.2:42685)
0928 13:05:34.080527 (+   174us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.080532 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.080632 (+   100us) server_negotiation.cc:407] Connection header received
0928 13:05:34.080695 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.080698 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.080713 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.080793 (+    80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:34.080898 (+   105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.081936 (+  1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.083251 (+  1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.084080 (+   829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.084157 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.084211 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.084308 (+    97us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.084345 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260928 13:05:34.084527 17751 tablet_service.cc:1467] Processing CreateTablet for tablet d09f873a164548b8bbe99bacc5b89c8f (DEFAULT_TABLE table=test-table [id=11ef171f8c8e4d33b88377c0d104b783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:34.084846 17751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f873a164548b8bbe99bacc5b89c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:34.085139 17619 tablet_service.cc:1467] Processing CreateTablet for tablet d09f873a164548b8bbe99bacc5b89c8f (DEFAULT_TABLE table=test-table [id=11ef171f8c8e4d33b88377c0d104b783]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:34.085417 17619 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d09f873a164548b8bbe99bacc5b89c8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:34.087594 17827 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Bootstrap starting.
I20260928 13:05:34.088210 17828 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Bootstrap starting.
I20260928 13:05:34.088410 17827 tablet_bootstrap.cc:654] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:34.088814 17828 tablet_bootstrap.cc:654] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:34.088943 17827 log.cc:824] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:34.089361 17828 log.cc:824] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:34.089756 17827 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: No bootstrap required, opened a new log
I20260928 13:05:34.089828 17827 ts_tablet_manager.cc:1397] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:34.090106 17828 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: No bootstrap required, opened a new log
I20260928 13:05:34.090173 17828 ts_tablet_manager.cc:1397] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:05:34.091498 17827 raft_consensus.cc:348] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.091636 17827 raft_consensus.cc:374] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:34.091658 17827 raft_consensus.cc:729] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc75970cc164e0d82dbd37e54fd88cb, State: Initialized, Role: FOLLOWER
I20260928 13:05:34.091770 17827 consensus_queue.cc:260] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.091795 17828 raft_consensus.cc:348] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.091971 17828 raft_consensus.cc:374] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:34.092044 17827 ts_tablet_manager.cc:1428] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:34.092060 17817 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
I20260928 13:05:34.092015 17828 raft_consensus.cc:729] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d089cf71aa443688a69b5a767045f8, State: Initialized, Role: FOLLOWER
I20260928 13:05:34.092412 17828 consensus_queue.cc:260] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.092692 17828 ts_tablet_manager.cc:1428] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:05:34.092690 17685 heartbeater.cc:503] Master 127.3.6.62:43569 was elected leader, sending a full tablet report...
I20260928 13:05:34.156363 17553 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:34.156533 17553 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.156929 17553 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
I20260928 13:05:34.160002 17823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.157335 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:57201 (local address 127.3.6.3:42559)
0928 13:05:34.157381 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.157383 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.157398 (+    15us) server_negotiation.cc:407] Connection header received
0928 13:05:34.157420 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.157421 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.157430 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.157499 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:34.157675 (+   176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.158166 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159192 (+  1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.159588 (+   396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159675 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.159686 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.159882 (+   196us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.159927 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:05:34.160002 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.157098 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:42559 (local address 127.3.6.1:57201)
0928 13:05:34.157152 (+    54us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.157165 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.157255 (+    90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.157505 (+   250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:34.157505 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:34.157507 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:34.157591 (+    84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.157592 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.158254 (+   662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.158256 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.159103 (+   847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.159106 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.159674 (+   568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159675 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.159766 (+    91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.159790 (+    24us) client_negotiation.cc:769] Sending connection context
0928 13:05:34.159874 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:05:34.159924 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:05:34.160147 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.157324 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:46009 (local address 127.3.6.2:42685)
0928 13:05:34.157398 (+    74us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.157400 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.157530 (+   130us) server_negotiation.cc:407] Connection header received
0928 13:05:34.157600 (+    70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.157600 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.157612 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.157696 (+    84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:34.157880 (+   184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.158353 (+   473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159373 (+  1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.159750 (+   377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159846 (+    96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.159857 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.160032 (+   175us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.160077 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 13:05:34.160148 17833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.157204 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42685 (local address 127.3.6.1:46009)
0928 13:05:34.157457 (+   253us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.157464 (+     7us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.157540 (+    76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.157704 (+   164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:34.157705 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:34.157707 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:34.157781 (+    74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.157783 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.158443 (+   660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.158444 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.159279 (+   835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:34.159281 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.159874 (+   593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.159875 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:34.159953 (+    78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.159956 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:05:34.160025 (+    69us) client_negotiation.cc:240] Negotiation successful
0928 13:05:34.160063 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":127,"threads_started":1}
I20260928 13:05:34.160423 17771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f873a164548b8bbe99bacc5b89c8f" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" is_pre_election: true
I20260928 13:05:34.160533 17639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f873a164548b8bbe99bacc5b89c8f" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d089cf71aa443688a69b5a767045f8" is_pre_election: true
I20260928 13:05:34.160609 17771 raft_consensus.cc:2454] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 0.
I20260928 13:05:34.160691 17639 raft_consensus.cc:2454] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 0.
I20260928 13:05:34.160856 17435 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99, ffc75970cc164e0d82dbd37e54fd88cb; no voters: 
I20260928 13:05:34.160986 17553 raft_consensus.cc:2781] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:05:34.161077 17553 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:05:34.161113 17553 raft_consensus.cc:3037] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:34.161827 17553 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.161984 17553 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 election: Requested vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
I20260928 13:05:34.162166 17771 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f873a164548b8bbe99bacc5b89c8f" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
I20260928 13:05:34.162215 17639 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d09f873a164548b8bbe99bacc5b89c8f" candidate_uuid: "0f16adb183fe4429bcb4758de31e1d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d089cf71aa443688a69b5a767045f8"
I20260928 13:05:34.162271 17771 raft_consensus.cc:3037] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:34.162323 17639 raft_consensus.cc:3037] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 0 FOLLOWER]: Advancing to term 1
W20260928 13:05:34.162817 17686 tablet.cc:2369] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:05:34.163133 17771 raft_consensus.cc:2454] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 1.
I20260928 13:05:34.163295 17639 raft_consensus.cc:2454] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f16adb183fe4429bcb4758de31e1d99 in term 1.
I20260928 13:05:34.163296 17435 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99, ffc75970cc164e0d82dbd37e54fd88cb; no voters: 
I20260928 13:05:34.163430 17553 raft_consensus.cc:2781] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:34.163596 17553 raft_consensus.cc:686] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 LEADER]: Becoming Leader. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Running, Role: LEADER
I20260928 13:05:34.163683 17553 consensus_queue.cc:237] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.164495 17358 catalog_manager.cc:5495] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "0f16adb183fe4429bcb4758de31e1d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } health_report { overall_health: HEALTHY } } }
I20260928 13:05:34.178216 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.175706 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48722 (local address 127.3.6.1:37879)
0928 13:05:34.175780 (+    74us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:34.175783 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:34.175792 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:05:34.175838 (+    46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:34.175839 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:34.175858 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:34.175934 (+    76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:05:34.176084 (+   150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.176608 (+   524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.177378 (+   770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:34.177604 (+   226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:34.177692 (+    88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:34.177866 (+   174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:05:34.177980 (+   114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:05:34.178065 (+    85us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:34.178104 (+    39us) server_negotiation.cc:299] Negotiation successful
0928 13:05:34.178127 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 13:05:34.179888 17771 raft_consensus.cc:1261] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Refusing update from remote peer 0f16adb183fe4429bcb4758de31e1d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:34.179889 17639 raft_consensus.cc:1261] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Refusing update from remote peer 0f16adb183fe4429bcb4758de31e1d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:34.180218 17553 consensus_queue.cc:1035] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:34.180371 17834 consensus_queue.cc:1035] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:34.183139 17836 mvcc.cc:205] Tried to move back new op lower bound from 7334300607197908992 to 7334300607134867456. Current Snapshot: MvccSnapshot[applied={T|T < 7334300607197908992}]
I20260928 13:05:34.183380 17837 mvcc.cc:205] Tried to move back new op lower bound from 7334300607197908992 to 7334300607134867456. Current Snapshot: MvccSnapshot[applied={T|T < 7334300607197908992}]
I20260928 13:05:34.185624 17359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:48066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:34.185748 17359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:48066:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:34.186512 17359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Sending DeleteTablet for 3 replicas of tablet d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:34.186883 17751 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f873a164548b8bbe99bacc5b89c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:34 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:36718
I20260928 13:05:34.186902 17619 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f873a164548b8bbe99bacc5b89c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:34 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:47846
I20260928 13:05:34.187253 17481 tablet_service.cc:1514] Processing DeleteTablet for tablet d09f873a164548b8bbe99bacc5b89c8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:34 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:48714
I20260928 13:05:34.187278  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17397
I20260928 13:05:34.187359 17556 tablet_replica.cc:330] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: stopping tablet replica
I20260928 13:05:34.187414 17556 raft_consensus.cc:2229] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:05:34.187507 17556 raft_consensus.cc:2258] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:34.187868 17846 tablet_replica.cc:330] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: stopping tablet replica
I20260928 13:05:34.187968 17846 raft_consensus.cc:2229] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:34.188071 17846 raft_consensus.cc:2258] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:34.188161 17847 tablet_replica.cc:330] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: stopping tablet replica
I20260928 13:05:34.188246 17847 raft_consensus.cc:2229] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:34.188365 17847 raft_consensus.cc:2258] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:34.188555 17846 ts_tablet_manager.cc:1905] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:34.189798 17847 ts_tablet_manager.cc:1905] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:34.190526 17846 ts_tablet_manager.cc:1918] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:34.190608 17846 log.cc:1196] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:34.190915 17846 ts_tablet_manager.cc:1939] T d09f873a164548b8bbe99bacc5b89c8f P ffc75970cc164e0d82dbd37e54fd88cb: Deleting consensus metadata
I20260928 13:05:34.191370 17345 catalog_manager.cc:4841] TS ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): tablet d09f873a164548b8bbe99bacc5b89c8f (table test-table [id=11ef171f8c8e4d33b88377c0d104b783]) successfully deleted
I20260928 13:05:34.191574 17847 ts_tablet_manager.cc:1918] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:34.191638 17847 log.cc:1196] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:34.191916 17847 ts_tablet_manager.cc:1939] T d09f873a164548b8bbe99bacc5b89c8f P c6d089cf71aa443688a69b5a767045f8: Deleting consensus metadata
I20260928 13:05:34.192442 17345 catalog_manager.cc:4841] TS c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): tablet d09f873a164548b8bbe99bacc5b89c8f (table test-table [id=11ef171f8c8e4d33b88377c0d104b783]) successfully deleted
W20260928 13:05:34.193667 17346 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:37879 (error 108)
I20260928 13:05:34.193995  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17552
I20260928 13:05:34.194129 17824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.193988 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37879 (local address 127.0.0.1:48724)
0928 13:05:34.194049 (+    61us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.194090 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37879: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260928 13:05:34.195791 17346 catalog_manager.cc:4584] TS 0f16adb183fe4429bcb4758de31e1d99 (127.3.6.1:37879): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d09f873a164548b8bbe99bacc5b89c8f: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37879: connect: Connection refused (error 111)
I20260928 13:05:34.198649  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17688
I20260928 13:05:34.204154  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17326
I20260928 13:05:34.209614  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--webserver_interface=127.3.6.62
--webserver_port=41561
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:43569
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:34.289932 17849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:34.290151 17849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:34.290175 17849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:34.291275 17849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:34.291312 17849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:34.291326 17849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:34.291339 17849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:34.291352 17849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:34.292744 17849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:43569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:43569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=41561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:34.292939 17849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:34.293113 17849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:34.297760 17855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.297787 17857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.297806 17854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:34.298007 17849 server_base.cc:1034] running on GCE node
I20260928 13:05:34.298226 17849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:34.298554 17849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:34.299715 17849 hybrid_clock.cc:648] HybridClock initialized: now 1790600734299710 us; error 36 us; skew 500 ppm
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:34.302065 17849 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:34.302492 17849 webserver.cc:460] Webserver started at http://127.3.6.62:41561/ using document root <none> and password file <none>
I20260928 13:05:34.302680 17849 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:34.302722 17849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:34.304059 17849 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.304651 17864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.304836 17849 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:34.304916 17849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "9ebb37a150714023bb82bd30e617cf54"
format_stamp: "Formatted at 2026-09-28 13:05:32 on dist-test-slave-ddvw"
server_key: "6e6cd06738ab1c594fac77533d3b58da"
server_key_iv: "d9b1b3e33dc839913e5343ab6d5abbe0"
server_key_version: "encryptionkey@0"
I20260928 13:05:34.305244 17849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:34.315802 17849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:34.317607 17849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:34.317715 17849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:34.321576 17849 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:43569
I20260928 13:05:34.321754 17916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:43569 every 8 connection(s)
I20260928 13:05:34.322063 17849 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:34.323736 17917 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:05:34.324374  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17849
I20260928 13:05:34.324542 17917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap starting.
I20260928 13:05:34.324678  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:37879
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=46449
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:34.333280 17917 log.cc:824] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:34.335660 17917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:05:34.335976 17917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54: Bootstrap complete.
I20260928 13:05:34.338296 17917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:34.338553 17917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Initialized, Role: FOLLOWER
I20260928 13:05:34.338737 17917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:34.338814 17917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:34.338866 17917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:34.338923 17917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 2 FOLLOWER]: Advancing to term 3
I20260928 13:05:34.339970 17917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:34.340092 17917 leader_election.cc:302] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ebb37a150714023bb82bd30e617cf54; no voters: 
I20260928 13:05:34.340299 17917 leader_election.cc:288] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [CANDIDATE]: Term 3 election: Requested vote from peers 
I20260928 13:05:34.340332 17921 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 13:05:34.340451 17921 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [term 3 LEADER]: Becoming Leader. State: Replica: 9ebb37a150714023bb82bd30e617cf54, State: Running, Role: LEADER
I20260928 13:05:34.340536 17921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } }
I20260928 13:05:34.340577 17917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:34.340817 17921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ebb37a150714023bb82bd30e617cf54. Latest consensus state: current_term: 3 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:34.340894 17921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:34.340823 17922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9ebb37a150714023bb82bd30e617cf54" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ebb37a150714023bb82bd30e617cf54" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 43569 } } }
I20260928 13:05:34.341077 17922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ebb37a150714023bb82bd30e617cf54 [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:34.341109 17925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:34.342028 17925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:34.342151 17925 catalog_manager.cc:1259] Loaded cluster ID: 92a78cc44926449d819c968aa25531c5
I20260928 13:05:34.342196 17925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260928 13:05:34.342505 17925 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
    @     0x7f23d3e399ad  google::LogMessage::Fail() at ??:0
    @     0x7f23d3e3c88a  google::LogMessage::SendToLog() at ??:0
    @     0x7f23d3e394de  google::LogMessage::Flush() at ??:0
    @     0x7f23d3e3aa19  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f23dbd5a0f1  _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
    @     0x7f23dbd638b9  kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
    @     0x7f23d5d070d3  kudu::ThreadPool::DispatchThread() at ??:0
    @     0x7f23d5cfc954  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f23d6b606db  start_thread at ??:0
    @     0x7f23d293761f  clone at ??:0
W20260928 13:05:34.415107 17919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:34.415336 17919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:34.415372 17919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:34.416544 17919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:34.416610 17919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:34.416657 17919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:34.418146 17919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:37879
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=46449
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:34.418417 17919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:34.418651 17919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:34.424733 17954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.424733 17956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.424729 17953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:34.425365 17919 server_base.cc:1034] running on GCE node
I20260928 13:05:34.425571 17919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:34.425830 17919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:34.426990 17919 hybrid_clock.cc:648] HybridClock initialized: now 1790600734426973 us; error 37 us; skew 500 ppm
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:34.429701 17919 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:34.430174 17919 webserver.cc:460] Webserver started at http://127.3.6.1:46449/ using document root <none> and password file <none>
I20260928 13:05:34.430405 17919 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:34.430450 17919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:34.431845 17919 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:34.432564 17963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.432744 17919 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.432842 17919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "0f16adb183fe4429bcb4758de31e1d99"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "ce64520ab6d1907336b701f7a7a9b85c"
server_key_iv: "66b5da3efb79466c6386c848a4983324"
server_key_version: "encryptionkey@0"
I20260928 13:05:34.433182 17919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:34.442320 17919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:34.444751 17919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:34.444906 17919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:34.445144 17919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:34.445585 17970 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 13:05:34.447523 17919 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 13:05:34.447597 17919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260928 13:05:34.447646 17919 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 13:05:34.448283 17919 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 13:05:34.448328 17919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:05:34.448378 17970 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap starting.
I20260928 13:05:34.455845 17919 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37879
I20260928 13:05:34.455941 18077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37879 every 8 connection(s)
I20260928 13:05:34.456445 17919 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:34.459363 17970 log.cc:824] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:34.460014  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 17919
I20260928 13:05:34.460307  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:42685
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=33453
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:05:34.461835 17970 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:05:34.462149 17970 tablet_bootstrap.cc:492] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Bootstrap complete.
I20260928 13:05:34.463279 17970 ts_tablet_manager.cc:1397] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.011s
I20260928 13:05:34.465091 17970 raft_consensus.cc:348] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.465497 17970 raft_consensus.cc:729] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f16adb183fe4429bcb4758de31e1d99, State: Initialized, Role: FOLLOWER
I20260928 13:05:34.465670 17970 consensus_queue.cc:260] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:34.465977 17970 ts_tablet_manager.cc:1428] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
W20260928 13:05:34.542275 18080 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:05:34.457184 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:47531)
0928 13:05:34.457397 (+   213us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.457448 (+    51us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:34.458236 (+   788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:34.542083 (+ 83847us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":104,"threads_started":1}
W20260928 13:05:34.542549 18078 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:43569 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:43569: Client connection negotiation failed: client connection to 127.3.6.62:43569: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 13:05:34.542888 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.542784 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:57483)
0928 13:05:34.542836 (+    52us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.542871 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 13:05:34.543217 18080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.543140 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:52281)
0928 13:05:34.543180 (+    40us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.543202 (+    22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260928 13:05:34.543339 18078 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:05:34.548461 18082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:34.548669 18082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:34.548695 18082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:34.549912 18082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:34.549955 18082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:34.549983 18082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:34.551563 18082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:42685
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=33453
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:34.551805 18082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:34.552047 18082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:34.557155 18088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.557150 18091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.557150 18089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:34.557487 18082 server_base.cc:1034] running on GCE node
I20260928 13:05:34.557685 18082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:34.557926 18082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:34.559094 18082 hybrid_clock.cc:648] HybridClock initialized: now 1790600734559076 us; error 26 us; skew 500 ppm
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:34.561645 18082 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:34.562083 18082 webserver.cc:460] Webserver started at http://127.3.6.2:33453/ using document root <none> and password file <none>
I20260928 13:05:34.562304 18082 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:34.562351 18082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:34.563795 18082 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:05:34.564389 18098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.564579 18082 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:05:34.564670 18082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "c6d089cf71aa443688a69b5a767045f8"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "09c0981037de7e2a0d3038093047e9c4"
server_key_iv: "e7eb8f4b2f7f4abe820dfd19dc3033c3"
server_key_version: "encryptionkey@0"
I20260928 13:05:34.565032 18082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:34.580575 18082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:34.582690 18082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:34.582858 18082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:34.583166 18082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:34.583494 18082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:34.583536 18082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.583582 18082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:34.583608 18082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.589887 18082 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42685
I20260928 13:05:34.589927 18211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42685 every 8 connection(s)
I20260928 13:05:34.590292 18082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:34.591611 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.591217 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:60317)
0928 13:05:34.591366 (+   149us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.591456 (+    90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
W20260928 13:05:34.592093 18212 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:43569 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:43569: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
I20260928 13:05:34.592433 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.592319 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:43461)
0928 13:05:34.592379 (+    60us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.592411 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:05:34.592760 18214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.592705 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:45271)
0928 13:05:34.592726 (+    21us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.592745 (+    19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260928 13:05:34.592885 18212 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 13:05:34.596803  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18082
I20260928 13:05:34.597061  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:42559
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:43569
--webserver_port=38171
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:34.677734 18215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:34.677994 18215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:34.678035 18215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:34.679448 18215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:34.679514 18215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:34.679557 18215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:34.680999 18215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:42559
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=38171
--tserver_master_addrs=127.3.6.62:43569
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:34.681257 18215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:34.681483 18215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:34.686414 18221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.686403 18220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:34.686403 18223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:34.686632 18215 server_base.cc:1034] running on GCE node
I20260928 13:05:34.686872 18215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:34.687175 18215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:34.688328 18215 hybrid_clock.cc:648] HybridClock initialized: now 1790600734688317 us; error 26 us; skew 500 ppm
Sep 28 13:05:34 dist-test-slave-ddvw krb5kdc[16779](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:34.690775 18215 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:34.691248 18215 webserver.cc:460] Webserver started at http://127.3.6.3:38171/ using document root <none> and password file <none>
I20260928 13:05:34.691524 18215 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:34.691571 18215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:34.692902 18215 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.693533 18230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.693718 18215 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:05:34.693818 18215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "ffc75970cc164e0d82dbd37e54fd88cb"
format_stamp: "Formatted at 2026-09-28 13:05:33 on dist-test-slave-ddvw"
server_key: "70d2e49eaebbec12e690df9fea3bf171"
server_key_iv: "52b440ff76acd81d1297c9e124dc2b39"
server_key_version: "encryptionkey@0"
I20260928 13:05:34.694185 18215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:34.704473 18215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:34.706326 18215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:34.706498 18215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:34.706729 18215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:34.707101 18215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:34.707154 18215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.707193 18215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:34.707221 18215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:34.713073 18215 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:42559
I20260928 13:05:34.713150 18343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:42559 every 8 connection(s)
I20260928 13:05:34.713513 18215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:34.714556 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.714203 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:39867)
0928 13:05:34.714348 (+   145us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.714419 (+    71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
W20260928 13:05:34.714965 18344 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:43569 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:43569: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
I20260928 13:05:34.715243 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.715160 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:57599)
0928 13:05:34.715203 (+    43us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.715228 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260928 13:05:34.715485 18346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:34.715422 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:41923)
0928 13:05:34.715442 (+    20us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:34.715458 (+    16us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260928 13:05:34.715587 18344 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 13:05:34.721983  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18215
I20260928 13:05:35.544095 18348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.543778 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:52451)
0928 13:05:35.543988 (+   210us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:35.544034 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":129,"threads_started":1}
I20260928 13:05:35.593448 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.593220 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:47237)
0928 13:05:35.593359 (+   139us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:35.593398 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260928 13:05:35.716105 18350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.715911 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:43261)
0928 13:05:35.716022 (+   111us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:35.716054 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260928 13:05:35.878424 18351 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:35.878607 18351 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:35.878985 18351 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
Sep 28 13:05:35 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.3@KRBTEST.COM
Sep 28 13:05:35 dist-test-slave-ddvw krb5kdc[16779](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600734, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.2@KRBTEST.COM
I20260928 13:05:35.891592 18353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.879351 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:60669 (local address 127.3.6.3:42559)
0928 13:05:35.879497 (+   146us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:35.879510 (+    13us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:35.879546 (+    36us) server_negotiation.cc:407] Connection header received
0928 13:05:35.880046 (+   500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:35.880048 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:35.880089 (+    41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:35.880234 (+   145us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:35.881003 (+   769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.882415 (+  1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884033 (+  1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.884660 (+   627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884778 (+   118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:35.887683 (+  2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:35.887688 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:35.887688 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:35.887701 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:35.889705 (+  2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890213 (+   508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:35.890216 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:35.890217 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:35.890304 (+    87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890621 (+   317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:35.890622 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:35.890622 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:35.890864 (+   242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:35.890954 (+    90us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:35.891324 (+   370us) server_negotiation.cc:299] Negotiation successful
0928 13:05:35.891470 (+   146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260928 13:05:35.891577 18348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.879187 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:42559 (local address 127.3.6.1:60669)
0928 13:05:35.879250 (+    63us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:35.879264 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:35.879347 (+    83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:35.880278 (+   931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:35.880280 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:35.880681 (+   401us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:35.880870 (+   189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:35.880876 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.882554 (+  1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.882554 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:35.883926 (+  1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:35.883929 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.884754 (+   825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884772 (+    18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:35.884903 (+   131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:35.885514 (+   611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:35.885642 (+   128us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:35.887558 (+  1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:35.889809 (+  2251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:35.889817 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:35.889819 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:35.890120 (+   301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:35.890394 (+   274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890395 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:35.890395 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:35.890540 (+   145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:35.890981 (+   441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:35.890988 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:35.891155 (+   167us) client_negotiation.cc:769] Sending connection context
0928 13:05:35.891272 (+   117us) client_negotiation.cc:240] Negotiation successful
0928 13:05:35.891470 (+   198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":79}
I20260928 13:05:35.891661 18354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.879448 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:35511 (local address 127.3.6.2:42685)
0928 13:05:35.879597 (+   149us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:35.879605 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:35.879631 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:05:35.880046 (+   415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:35.880048 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:35.880089 (+    41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:35.880238 (+   149us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:35.881058 (+   820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.882415 (+  1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884033 (+  1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.884660 (+   627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884777 (+   117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:35.888167 (+  3390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:35.888171 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:35.888172 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:35.888191 (+    19us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:35.890109 (+  1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890485 (+   376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:35.890489 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:35.890490 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:35.890585 (+    95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890807 (+   222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:35.890807 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:35.890808 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:35.891097 (+   289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:35.891187 (+    90us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:35.891376 (+   189us) server_negotiation.cc:299] Negotiation successful
0928 13:05:35.891543 (+   167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":69,"threads_started":1}
I20260928 13:05:35.892056 18352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:35.879330 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42685 (local address 127.3.6.1:35511)
0928 13:05:35.879458 (+   128us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:35.879467 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:35.879506 (+    39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:35.880336 (+   830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:35.880337 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:35.880680 (+   343us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:35.880870 (+   190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:35.880876 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.882550 (+  1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.882552 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:35.883926 (+  1374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:35.883929 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:35.884754 (+   825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:35.884770 (+    16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:35.884906 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:35.885665 (+   759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:35.885670 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:35.888050 (+  2380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:35.890226 (+  2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890227 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:35.890227 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:35.890383 (+   156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:35.890660 (+   277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:35.890661 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:35.890661 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:35.890735 (+    74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:35.891170 (+   435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:35.891170 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:35.891217 (+    47us) client_negotiation.cc:769] Sending connection context
0928 13:05:35.891303 (+    86us) client_negotiation.cc:240] Negotiation successful
0928 13:05:35.891555 (+   252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"mutex_wait_us":206,"thread_start_us":60,"threads_started":1}
W20260928 13:05:35.892652 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:35.892750 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:35.892795 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:35.892899 18351 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:36.544845 18355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:36.544633 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:51195)
0928 13:05:36.544757 (+   124us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:36.544797 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":65,"threads_started":1}
I20260928 13:05:36.594080 18356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:36.593899 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:34577)
0928 13:05:36.594008 (+   109us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:36.594044 (+    36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260928 13:05:36.716921 18357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:36.716552 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:36267)
0928 13:05:36.716847 (+   295us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:36.716877 (+    30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":251,"threads_started":1}
I20260928 13:05:37.545565 18358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:37.545322 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:59843)
0928 13:05:37.545480 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:37.545519 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":68,"threads_started":1}
I20260928 13:05:37.594851 18359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:37.594600 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:58891)
0928 13:05:37.594758 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:37.594798 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":87,"threads_started":1}
I20260928 13:05:37.611418 18360 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:37.611514 18360 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:37.611716 18360 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
W20260928 13:05:37.612250 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:37.612372 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:37.612407 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:37.612509 18360 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:37.717694 18361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:37.717465 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:59201)
0928 13:05:37.717609 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:37.717648 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260928 13:05:38.546206 18362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:38.546001 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:48717)
0928 13:05:38.546127 (+   126us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:38.546158 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
I20260928 13:05:38.595590 18363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:38.595331 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:36615)
0928 13:05:38.595492 (+   161us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:38.595542 (+    50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":62,"threads_started":1}
I20260928 13:05:38.718458 18364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:38.718240 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:51141)
0928 13:05:38.718373 (+   133us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:38.718414 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":58,"threads_started":1}
I20260928 13:05:39.300493 18365 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:39.300591 18365 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:39.300776 18365 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
W20260928 13:05:39.301227 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:39.301299 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:39.301316 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:39.301379 18365 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:39.547178 18366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:39.546887 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:54779)
0928 13:05:39.547087 (+   200us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:39.547133 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
I20260928 13:05:39.596297 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:39.596103 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:60521)
0928 13:05:39.596215 (+   112us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:39.596255 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":56,"threads_started":1}
I20260928 13:05:39.719262 18368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:39.719061 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:48023)
0928 13:05:39.719184 (+   123us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:39.719218 (+    34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":68,"threads_started":1}
I20260928 13:05:40.547851 18369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:40.547627 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:51043)
0928 13:05:40.547767 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:40.547802 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":64,"threads_started":1}
I20260928 13:05:40.597066 18370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:40.596834 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:52451)
0928 13:05:40.596980 (+   146us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:40.597020 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":61,"threads_started":1}
I20260928 13:05:40.719926 18371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:40.719717 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:46597)
0928 13:05:40.719838 (+   121us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:40.719878 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260928 13:05:41.548488 18372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:41.548275 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:49003)
0928 13:05:41.548403 (+   128us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:41.548441 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":61,"threads_started":1}
I20260928 13:05:41.597862 18373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:41.597646 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:50305)
0928 13:05:41.597775 (+   129us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:41.597818 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260928 13:05:41.720759 18374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:41.720511 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:38859)
0928 13:05:41.720667 (+   156us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:41.720711 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":67,"threads_started":1}
I20260928 13:05:41.737083 18375 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:41.737177 18375 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:41.737378 18375 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
W20260928 13:05:41.737795 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:41.737864 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:41.737880 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:41.737951 18375 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:42.549288 18376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:42.549047 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:48645)
0928 13:05:42.549207 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:42.549240 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
I20260928 13:05:42.598673 18377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:42.598451 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:36487)
0928 13:05:42.598587 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:42.598630 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":73,"threads_started":1}
I20260928 13:05:42.721443 18378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:42.721230 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:44239)
0928 13:05:42.721364 (+   134us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:42.721400 (+    36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260928 13:05:43.550009 18379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:43.549759 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:45281)
0928 13:05:43.549917 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:43.549959 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260928 13:05:43.599356 18380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:43.599156 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:44331)
0928 13:05:43.599274 (+   118us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:43.599312 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260928 13:05:43.722131 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:43.721910 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:36809)
0928 13:05:43.722040 (+   130us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:43.722081 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
I20260928 13:05:44.550772 18382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:44.550537 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:50879)
0928 13:05:44.550686 (+   149us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:44.550723 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":93,"threads_started":1}
I20260928 13:05:44.600152 18383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:44.599898 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:33267)
0928 13:05:44.600042 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:44.600104 (+    62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
I20260928 13:05:44.722820 18384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:44.722610 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:43513)
0928 13:05:44.722736 (+   126us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:44.722774 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260928 13:05:45.551538 18385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:45.551300 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:43765)
0928 13:05:45.551444 (+   144us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:45.551488 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260928 13:05:45.600917 18386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:45.600659 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:37347)
0928 13:05:45.600829 (+   170us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:45.600870 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":65,"threads_started":1}
I20260928 13:05:45.723501 18387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:45.723306 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:38265)
0928 13:05:45.723419 (+   113us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:45.723454 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":58,"threads_started":1}
I20260928 13:05:46.552191 18388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:46.551996 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:45067)
0928 13:05:46.552117 (+   121us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:46.552146 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260928 13:05:46.552438 18389 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:46.552511 18389 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:46.552630 18389 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
W20260928 13:05:46.552956 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:46.553040 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:46.553062 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:46.553206 18389 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:46.601637 18390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:46.601411 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:35875)
0928 13:05:46.601549 (+   138us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:46.601590 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":61,"threads_started":1}
I20260928 13:05:46.724251 18391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:46.724032 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:56261)
0928 13:05:46.724164 (+   132us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:46.724204 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260928 13:05:47.552994 18392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:47.552721 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:57601)
0928 13:05:47.552857 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:47.552903 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260928 13:05:47.602361 18393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:47.602125 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:36493)
0928 13:05:47.602271 (+   146us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:47.602315 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":63,"threads_started":1}
I20260928 13:05:47.725066 18394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:47.724757 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:40143)
0928 13:05:47.724920 (+   163us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:47.724974 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":74,"threads_started":1}
I20260928 13:05:48.479089 18395 raft_consensus.cc:482] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:48.479203 18395 raft_consensus.cc:504] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc75970cc164e0d82dbd37e54fd88cb" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 42559 } } peers { permanent_uuid: "c6d089cf71aa443688a69b5a767045f8" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42685 } } peers { permanent_uuid: "0f16adb183fe4429bcb4758de31e1d99" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37879 } }
I20260928 13:05:48.479386 18395 leader_election.cc:288] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559), c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685)
W20260928 13:05:48.479821 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ffc75970cc164e0d82dbd37e54fd88cb (127.3.6.3:42559): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
W20260928 13:05:48.479898 17966 leader_election.cc:341] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c6d089cf71aa443688a69b5a767045f8 (127.3.6.2:42685): Not found: Tablet not found: d09f873a164548b8bbe99bacc5b89c8f
I20260928 13:05:48.479914 17966 leader_election.cc:302] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f16adb183fe4429bcb4758de31e1d99; no voters: c6d089cf71aa443688a69b5a767045f8, ffc75970cc164e0d82dbd37e54fd88cb
I20260928 13:05:48.480018 18395 raft_consensus.cc:2726] T d09f873a164548b8bbe99bacc5b89c8f P 0f16adb183fe4429bcb4758de31e1d99 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 13:05:48.553714 18396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:48.553497 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:34833)
0928 13:05:48.553623 (+   126us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:48.553666 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260928 13:05:48.603195 18397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:48.602875 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:56429)
0928 13:05:48.603081 (+   206us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:48.603131 (+    50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260928 13:05:48.725903 18398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:48.725669 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:38579)
0928 13:05:48.725809 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:48.725853 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260928 13:05:49.554452 18399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:49.554244 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.1:53235)
0928 13:05:49.554371 (+   127us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:49.554406 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260928 13:05:49.603891 18400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:49.603700 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.2:57399)
0928 13:05:49.603815 (+   115us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:49.603848 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
I20260928 13:05:49.726809 18401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:49.726551 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:43569 (local address 127.3.6.3:53087)
0928 13:05:49.726694 (+   143us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:49.726749 (+    55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:43569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260928 13:05:49.727048  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 17919
I20260928 13:05:49.731844  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18082
I20260928 13:05:49.736528  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18215
2026-09-28T13:05:49Z chronyd exiting
[       OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18148 ms)
[ RUN      ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:05:49 dist-test-slave-ddvw krb5kdc[18404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:05:49 dist-test-slave-ddvw krb5kdc[18404](info): set up 2 sockets
Sep 28 13:05:49 dist-test-slave-ddvw krb5kdc[18404](info): commencing operation
krb5kdc: starting...
W20260928 13:05:50.787056  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.029s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:05:50 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:05:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:05:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:05:50.905717  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:41275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:50.987108 18417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:50.987316 18417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:50.987340 18417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:50.988533 18417 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 13:05:50.988572 18417 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 13:05:50.988585 18417 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 13:05:50.988597 18417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:05:50.988639 18417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:50.988670 18417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:50.988687 18417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:05:50.988709 18417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:05:50.990196 18417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:41275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:50.990458 18417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:50.990705 18417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:50.995512 18423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:50.995512 18422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:50.995627 18417 server_base.cc:1034] running on GCE node
W20260928 13:05:50.995596 18425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:50.996021 18417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:50.996316 18417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:50.997478 18417 hybrid_clock.cc:648] HybridClock initialized: now 1790600750997468 us; error 39 us; skew 500 ppm
Sep 28 13:05:50 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600750, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:50.999879 18417 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:05:51.000283 18417 webserver.cc:460] Webserver started at http://127.3.6.62:34515/ using document root <none> and password file <none>
I20260928 13:05:51.000478 18417 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:51.000519 18417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:51.000605 18417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:51.001607 18417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "6c3990e512c74a68bcdb98be4323f9ef"
format_stamp: "Formatted at 2026-09-28 13:05:50 on dist-test-slave-ddvw"
server_key: "82c153a05d50edb9ce37c202578e94d5"
server_key_iv: "80d2da05490c65bf44acf3bc9913960f"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.001893 18417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "6c3990e512c74a68bcdb98be4323f9ef"
format_stamp: "Formatted at 2026-09-28 13:05:50 on dist-test-slave-ddvw"
server_key: "82c153a05d50edb9ce37c202578e94d5"
server_key_iv: "80d2da05490c65bf44acf3bc9913960f"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.003153 18417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:05:51.003850 18432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.004024 18417 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.004091 18417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "6c3990e512c74a68bcdb98be4323f9ef"
format_stamp: "Formatted at 2026-09-28 13:05:50 on dist-test-slave-ddvw"
server_key: "82c153a05d50edb9ce37c202578e94d5"
server_key_iv: "80d2da05490c65bf44acf3bc9913960f"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.004143 18417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:51.013859 18417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:51.015632 18417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:51.015735 18417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:51.019477 18417 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:41275
I20260928 13:05:51.019541 18484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:41275 every 8 connection(s)
I20260928 13:05:51.019874 18417 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:05:51.020560  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18417
I20260928 13:05:51.020665  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:05:51.020871  3096 external_mini_cluster.cc:1428] Setting key a8eb798a777ac793e41de8287da4beff
I20260928 13:05:51.020897 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:51.024375 18485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap starting.
I20260928 13:05:51.025044 18485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:51.025331 18485 log.cc:824] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:51.026067 18485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: No bootstrap required, opened a new log
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:51.027971 18485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:05:51.028136 18485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:51.028184 18485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Initialized, Role: FOLLOWER
I20260928 13:05:51.028339 18485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:05:51.028434 18485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:05:51.028466 18485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:05:51.028537 18485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:51.029219 18485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:05:51.029335 18485 leader_election.cc:302] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c3990e512c74a68bcdb98be4323f9ef; no voters: 
I20260928 13:05:51.029489 18485 leader_election.cc:288] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:05:51.029520 18490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:51.029639 18490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 LEADER]: Becoming Leader. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Running, Role: LEADER
I20260928 13:05:51.029750 18485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:05:51.029772 18490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:05:51.030090 18492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:05:51.030192 18492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:51.030078 18490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3990e512c74a68bcdb98be4323f9ef. Latest consensus state: current_term: 1 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:05:51.030689 18490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:05:51.030923 18496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:05:51.031494 18496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:05:51.032055 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.021377 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56436 (local address 127.3.6.62:41275)
0928 13:05:51.021549 (+   172us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.021557 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.021591 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:05:51.022138 (+   547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.022145 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.022198 (+    53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.022307 (+   109us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:51.023098 (+   791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.024013 (+   915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.025039 (+  1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.025518 (+   479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.025639 (+   121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.027944 (+  2305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:51.027948 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:51.027948 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:51.027966 (+    18us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:51.030014 (+  2048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.030438 (+   424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.030440 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.030441 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.030539 (+    98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.030737 (+   198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.030738 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.030739 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.031080 (+   341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:51.031654 (+   574us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.031725 (+    71us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.031856 (+   131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260928 13:05:51.032987 18496 catalog_manager.cc:1347] Generated new cluster ID: 36b9e72e6e5941e0b465b51d8a875b40
I20260928 13:05:51.033028 18496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:05:51.046469 18496 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:05:51.047080 18496 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:05:51.051877 18496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Generated new TSK 0
I20260928 13:05:51.052073 18496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:05:51.081717  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:51.183082 18511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:51.183293 18511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:51.183316 18511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:51.184474 18511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:51.184517 18511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:51.184543 18511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:05:51.185951 18511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:51.186182 18511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:51.186417 18511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:51.191452 18516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:51.191419 18519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:51.191419 18517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:51.191768 18511 server_base.cc:1034] running on GCE node
I20260928 13:05:51.191972 18511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:51.192231 18511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:51.193369 18511 hybrid_clock.cc:648] HybridClock initialized: now 1790600751193357 us; error 28 us; skew 500 ppm
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:51.195779 18511 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:05:51.196255 18511 webserver.cc:460] Webserver started at http://127.3.6.1:34693/ using document root <none> and password file <none>
I20260928 13:05:51.196468 18511 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:51.196511 18511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:51.196671 18511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:51.197742 18511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "5f8731c5f5134712b77f001cb3abf328"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "845af5934f2c9283c06c79b8110a65f6"
server_key_iv: "e0e058a50663b3d636fe866072b45c12"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.198089 18511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "5f8731c5f5134712b77f001cb3abf328"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "845af5934f2c9283c06c79b8110a65f6"
server_key_iv: "e0e058a50663b3d636fe866072b45c12"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.199427 18511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:05:51.200119 18526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.200307 18511 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:05:51.200394 18511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "5f8731c5f5134712b77f001cb3abf328"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "845af5934f2c9283c06c79b8110a65f6"
server_key_iv: "e0e058a50663b3d636fe866072b45c12"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.200465 18511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:51.214427 18511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:51.216300 18511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:51.216456 18511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:51.216682 18511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:51.216990 18511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:51.217042 18511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.217083 18511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:51.217120 18511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.223336 18511 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:36447
I20260928 13:05:51.223382 18639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:36447 every 8 connection(s)
I20260928 13:05:51.223713 18511 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:05:51.227516  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18511
I20260928 13:05:51.227626  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:05:51.227857  3096 external_mini_cluster.cc:1428] Setting key ae70dfb96506b8a9ea4653923b204fdc
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:51.234723 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.224462 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:54059 (local address 127.3.6.62:41275)
0928 13:05:51.224551 (+    89us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.224553 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.224775 (+   222us) server_negotiation.cc:407] Connection header received
0928 13:05:51.225340 (+   565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.225341 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.225355 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.225410 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:51.226427 (+  1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.226955 (+   528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.228200 (+  1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.228407 (+   207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.228494 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.230871 (+  2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:51.230873 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:51.230873 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:51.230880 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:51.232805 (+  1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.233377 (+   572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.233379 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.233379 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.233493 (+   114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.233869 (+   376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.233869 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.233870 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.234002 (+   132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:51.234057 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.234461 (+   404us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.234579 (+   118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:05:51.234988 18642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.224448 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:54059)
0928 13:05:51.224639 (+   191us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.224677 (+    38us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.225223 (+   546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.225498 (+   275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.225501 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.226093 (+   592us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:51.226302 (+   209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.226306 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.227072 (+   766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.227073 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.228122 (+  1049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.228125 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.228491 (+   366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.228504 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.228649 (+   145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.229239 (+   590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:51.229248 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:51.230779 (+  1531us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:51.232904 (+  2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.232912 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.232914 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.233267 (+   353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.233636 (+   369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.233637 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.233638 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.233801 (+   163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.234058 (+   257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:51.234081 (+    23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:51.234272 (+   191us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.234413 (+   141us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.234623 (+   210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":74,"threads_started":1}
I20260928 13:05:51.235769 18640 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:05:51.235903 18640 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:51.236140 18640 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:05:51.236881 18449 ts_manager.cc:194] Registered new tserver with Master: 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447)
I20260928 13:05:51.237936 18449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:54059
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:05:51.257282  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:51.339622 18645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:51.339882 18645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:51.339922 18645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:51.341113 18645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:51.341187 18645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:51.341231 18645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:05:51.342945 18645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:51.343307 18645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:51.343559 18645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:51.348556 18653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:51.348557 18651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:51.348632 18650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:51.348783 18645 server_base.cc:1034] running on GCE node
I20260928 13:05:51.349098 18645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:51.349294 18645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:51.350430 18645 hybrid_clock.cc:648] HybridClock initialized: now 1790600751350417 us; error 29 us; skew 500 ppm
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:51.352888 18645 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:05:51.353385 18645 webserver.cc:460] Webserver started at http://127.3.6.2:33873/ using document root <none> and password file <none>
I20260928 13:05:51.353607 18645 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:51.353675 18645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:51.353826 18645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:51.354866 18645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "64556ad65b8a48c29469e2ad55820193"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "73359d82bda88cd676e6fc5506f15920"
server_key_iv: "5fd69b132e1123f6f89aa9b0f3ebcf76"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.355260 18645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "64556ad65b8a48c29469e2ad55820193"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "73359d82bda88cd676e6fc5506f15920"
server_key_iv: "5fd69b132e1123f6f89aa9b0f3ebcf76"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.356562 18645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:05:51.357349 18660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.357527 18645 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:05:51.357635 18645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "64556ad65b8a48c29469e2ad55820193"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "73359d82bda88cd676e6fc5506f15920"
server_key_iv: "5fd69b132e1123f6f89aa9b0f3ebcf76"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.357712 18645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:51.369884 18645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:51.371927 18645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:51.372102 18645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:51.372354 18645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:51.372674 18645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:51.372731 18645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.372772 18645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:51.372802 18645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.378724 18645 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42245
I20260928 13:05:51.378775 18773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42245 every 8 connection(s)
I20260928 13:05:51.379211 18645 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:05:51.382416  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18645
I20260928 13:05:51.382530  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:05:51.382735  3096 external_mini_cluster.cc:1428] Setting key 591fb7a89782a6fc5cccd67f2cdb730a
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:51.389717 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.379968 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:38617 (local address 127.3.6.62:41275)
0928 13:05:51.380044 (+    76us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.380046 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.380257 (+   211us) server_negotiation.cc:407] Connection header received
0928 13:05:51.380718 (+   461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.380719 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.380729 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.380787 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:51.381714 (+   927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.382227 (+   513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.383728 (+  1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.383912 (+   184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.383969 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.386516 (+  2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:51.386517 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:51.386517 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:51.386524 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:51.388108 (+  1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.388651 (+   543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.388652 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.388652 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.388704 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.389027 (+   323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.389027 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.389028 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.389144 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:51.389199 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.389562 (+   363us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.389647 (+    85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:05:51.390020 18776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.379934 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:38617)
0928 13:05:51.380123 (+   189us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.380165 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.380636 (+   471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.380838 (+   202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.380842 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.381407 (+   565us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:51.381604 (+   197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.381609 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.382328 (+   719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.382329 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.383642 (+  1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.383645 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.384007 (+   362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.384018 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.384169 (+   151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.384780 (+   611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:51.384791 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:51.386414 (+  1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:51.388192 (+  1778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.388200 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.388203 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.388561 (+   358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.388767 (+   206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.388768 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.388768 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.388928 (+   160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.389215 (+   287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:51.389221 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:51.389414 (+   193us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.389548 (+   134us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.389755 (+   207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":82,"threads_started":1}
I20260928 13:05:51.390513 18774 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:05:51.390633 18774 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:51.390813 18774 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:05:51.391247 18449 ts_manager.cc:194] Registered new tserver with Master: 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245)
I20260928 13:05:51.391649 18449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:38617
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:05:51.407869  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:05:51.487525 18779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:05:51.487726 18779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:05:51.487749 18779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:05:51.488822 18779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:05:51.488858 18779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:05:51.488884 18779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:05:51.490260 18779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:05:51.490444 18779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:05:51.490628 18779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:05:51.495615 18785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:51.495772 18779 server_base.cc:1034] running on GCE node
W20260928 13:05:51.495621 18787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:05:51.495626 18784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:05:51.496052 18779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:05:51.496331 18779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:05:51.497498 18779 hybrid_clock.cc:648] HybridClock initialized: now 1790600751497488 us; error 28 us; skew 500 ppm
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:05:51.500078 18779 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:05:51.500547 18779 webserver.cc:460] Webserver started at http://127.3.6.3:41227/ using document root <none> and password file <none>
I20260928 13:05:51.500783 18779 fs_manager.cc:359] Metadata directory not provided
I20260928 13:05:51.500852 18779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:05:51.501010 18779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:05:51.502102 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "143a04b1ba19495686b805d9f2ecc9b4"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "abc8f221cba1b59472e85d17176e24a9"
server_key_iv: "e4153edbd3f23d9f1b77eff071551caa"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.502467 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "143a04b1ba19495686b805d9f2ecc9b4"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "abc8f221cba1b59472e85d17176e24a9"
server_key_iv: "e4153edbd3f23d9f1b77eff071551caa"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.503978 18779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:05:51.504777 18794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.504949 18779 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:05:51.505050 18779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "143a04b1ba19495686b805d9f2ecc9b4"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "abc8f221cba1b59472e85d17176e24a9"
server_key_iv: "e4153edbd3f23d9f1b77eff071551caa"
server_key_version: "encryptionkey@0"
I20260928 13:05:51.505141 18779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:05:51.517654 18779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:05:51.519747 18779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:05:51.519934 18779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:05:51.520203 18779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:05:51.520515 18779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:05:51.520576 18779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.520638 18779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:05:51.520669 18779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:05:51.526777 18779 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:40369
I20260928 13:05:51.526823 18907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:40369 every 8 connection(s)
I20260928 13:05:51.527266 18779 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:05:51.532429  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18779
I20260928 13:05:51.532538  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:05:51.532722  3096 external_mini_cluster.cc:1428] Setting key 81e2d80be18b9fbe58c2773d3d440e83
Sep 28 13:05:51 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600751, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:05:51.537915 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.528029 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:56337 (local address 127.3.6.62:41275)
0928 13:05:51.528102 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.528104 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.528345 (+   241us) server_negotiation.cc:407] Connection header received
0928 13:05:51.528827 (+   482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.528828 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.528838 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.528900 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:51.530031 (+  1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.530634 (+   603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.531787 (+  1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.532051 (+   264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.532119 (+    68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.534683 (+  2564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:51.534685 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:51.534685 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:51.534692 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:51.535979 (+  1287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.536584 (+   605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.536585 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.536586 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.536654 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.537039 (+   385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.537041 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.537041 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.537237 (+   196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:51.537302 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.537722 (+   420us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.537817 (+    95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 13:05:51.538499 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.528015 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:56337)
0928 13:05:51.528209 (+   194us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.528252 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.528745 (+   493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.528971 (+   226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.528975 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.529661 (+   686us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:05:51.529944 (+   283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.529951 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.530699 (+   748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.530700 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.531700 (+  1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.531703 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.532133 (+   430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.532144 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.532279 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.532967 (+   688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:05:51.532978 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:05:51.534597 (+  1619us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:05:51.536108 (+  1511us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.536117 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.536121 (+     4us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.536504 (+   383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.536737 (+   233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:05:51.536738 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:05:51.536738 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:05:51.536902 (+   164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:05:51.537321 (+   419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:05:51.537329 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:05:51.537528 (+   199us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.538039 (+   511us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.538273 (+   234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260928 13:05:51.539096 18908 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:05:51.539196 18908 heartbeater.cc:464] Registering TS with master...
I20260928 13:05:51.539350 18908 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:05:51.539834 18449 ts_manager.cc:194] Registered new tserver with Master: 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
I20260928 13:05:51.540268 18449 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:56337
I20260928 13:05:51.544580  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:05:51.552126 18488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.545981 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56438 (local address 127.3.6.62:41275)
0928 13:05:51.546037 (+    56us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.546039 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.546098 (+    59us) server_negotiation.cc:407] Connection header received
0928 13:05:51.546165 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.546165 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.546174 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.546228 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:05:51.546751 (+   523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.547324 (+   573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.548029 (+   705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.548232 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.548284 (+    52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.549486 (+  1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:05:51.549487 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:05:51.549487 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:05:51.549493 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:05:51.550924 (+  1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.551302 (+   378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.551303 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.551303 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.551356 (+    53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:05:51.551518 (+   162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:05:51.551518 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:05:51.551519 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:05:51.551666 (+   147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:05:51.551749 (+    83us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.551891 (+   142us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.551985 (+    94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 13:05:51.553650 18449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56438:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:05:51.555265 18449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:05:51.561998 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557799 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44456 (local address 127.3.6.2:42245)
0928 13:05:51.558018 (+   219us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.558022 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.558032 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:05:51.558066 (+    34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.558067 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.558081 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.558150 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:51.558407 (+   257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559590 (+  1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.560944 (+  1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561628 (+   684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561694 (+    66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.561756 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.561874 (+   118us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.561912 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":119,"threads_started":1}
I20260928 13:05:51.561990 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557476 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.0.0.1:44456)
0928 13:05:51.557603 (+   127us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.557656 (+    53us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.557723 (+    67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.558192 (+   469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.558195 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.558197 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:51.558280 (+    83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.558282 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559715 (+  1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.559716 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.560859 (+  1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.560861 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561693 (+   832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561694 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.561771 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.561785 (+    14us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.561858 (+    73us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.561911 (+    53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":58,"thread_start_us":54,"threads_started":1}
I20260928 13:05:51.562198 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557670 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:40369 (local address 127.0.0.1:51754)
0928 13:05:51.558257 (+   587us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.558266 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.558313 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.558543 (+   230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.558544 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.558546 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:51.558590 (+    44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.558591 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559839 (+  1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.559840 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.560977 (+  1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.560979 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561970 (+   991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561971 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.562033 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.562037 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.562083 (+    46us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.562124 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":79,"threads_started":1}
I20260928 13:05:51.562211 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557597 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41464 (local address 127.3.6.1:36447)
0928 13:05:51.558041 (+   444us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.558044 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.558202 (+   158us) server_negotiation.cc:407] Connection header received
0928 13:05:51.558253 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.558255 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.558276 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.558367 (+    91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:51.558596 (+   229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559488 (+   892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.560993 (+  1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561728 (+   735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561777 (+    49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.561830 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.562054 (+   224us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.562130 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":89,"threads_started":1}
I20260928 13:05:51.562388 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557476 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36447 (local address 127.0.0.1:41464)
0928 13:05:51.558086 (+   610us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.558094 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.558182 (+    88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.558451 (+   269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.558453 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.558455 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:51.558507 (+    52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.558509 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559588 (+  1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.559589 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.560890 (+  1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.560893 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561894 (+  1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561895 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.561960 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.561964 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.562282 (+   318us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.562331 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":3,"thread_start_us":65,"threads_started":1}
I20260928 13:05:51.562737 18923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.557821 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51754 (local address 127.3.6.3:40369)
0928 13:05:51.557990 (+   169us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.557995 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.558330 (+   335us) server_negotiation.cc:407] Connection header received
0928 13:05:51.558386 (+    56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.558388 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.558402 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.558471 (+    69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:51.558655 (+   184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.559741 (+  1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561075 (+  1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.561833 (+   758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.561894 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.561939 (+    45us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.562369 (+   430us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.562413 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260928 13:05:51.562963 18708 tablet_service.cc:1467] Processing CreateTablet for tablet ff4799f3e3b24e219e56a83077458e57 (DEFAULT_TABLE table=test-table [id=b250a1943a334554af8f8a0699de1af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:51.563081 18574 tablet_service.cc:1467] Processing CreateTablet for tablet ff4799f3e3b24e219e56a83077458e57 (DEFAULT_TABLE table=test-table [id=b250a1943a334554af8f8a0699de1af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:51.563388 18708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff4799f3e3b24e219e56a83077458e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:51.563339 18842 tablet_service.cc:1467] Processing CreateTablet for tablet ff4799f3e3b24e219e56a83077458e57 (DEFAULT_TABLE table=test-table [id=b250a1943a334554af8f8a0699de1af2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:05:51.563436 18574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff4799f3e3b24e219e56a83077458e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:51.563604 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff4799f3e3b24e219e56a83077458e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:05:51.565901 18925 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Bootstrap starting.
I20260928 13:05:51.566444 18925 tablet_bootstrap.cc:654] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:51.566704 18927 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Bootstrap starting.
I20260928 13:05:51.566938 18926 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Bootstrap starting.
I20260928 13:05:51.567147 18925 log.cc:824] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:51.567706 18927 tablet_bootstrap.cc:654] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:51.567936 18925 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: No bootstrap required, opened a new log
I20260928 13:05:51.568020 18925 ts_tablet_manager.cc:1397] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:05:51.568302 18927 log.cc:824] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:51.568934 18927 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: No bootstrap required, opened a new log
I20260928 13:05:51.569031 18927 ts_tablet_manager.cc:1397] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:05:51.569159 18926 tablet_bootstrap.cc:654] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Neither blocks nor log segments found. Creating new log.
I20260928 13:05:51.569700 18926 log.cc:824] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:05:51.570230 18925 raft_consensus.cc:348] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.570372 18925 raft_consensus.cc:374] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:51.570394 18925 raft_consensus.cc:729] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64556ad65b8a48c29469e2ad55820193, State: Initialized, Role: FOLLOWER
I20260928 13:05:51.570531 18925 consensus_queue.cc:260] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.570817 18925 ts_tablet_manager.cc:1428] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20260928 13:05:51.570880 18774 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
I20260928 13:05:51.570924 18927 raft_consensus.cc:348] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.571178 18927 raft_consensus.cc:374] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:51.571223 18927 raft_consensus.cc:729] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Initialized, Role: FOLLOWER
I20260928 13:05:51.571357 18927 consensus_queue.cc:260] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.571488 18926 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: No bootstrap required, opened a new log
I20260928 13:05:51.571554 18926 ts_tablet_manager.cc:1397] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260928 13:05:51.571642 18927 ts_tablet_manager.cc:1428] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:05:51.571756 18640 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
I20260928 13:05:51.573292 18926 raft_consensus.cc:348] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.573472 18926 raft_consensus.cc:374] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:05:51.573508 18926 raft_consensus.cc:729] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 143a04b1ba19495686b805d9f2ecc9b4, State: Initialized, Role: FOLLOWER
I20260928 13:05:51.573606 18926 consensus_queue.cc:260] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.573802 18926 ts_tablet_manager.cc:1428] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:05:51.573848 18908 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
W20260928 13:05:51.629848 18775 tablet.cc:2369] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:05:51.724442 18641 tablet.cc:2369] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 13:05:51.777879 18909 tablet.cc:2369] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:05:51.876452 18932 raft_consensus.cc:482] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:05:51.876619 18932 raft_consensus.cc:504] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.876993 18932 leader_election.cc:288] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369), 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245)
I20260928 13:05:51.880113 18923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.877361 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:42585 (local address 127.3.6.3:40369)
0928 13:05:51.877407 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.877409 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.877419 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:05:51.877495 (+    76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.877496 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.877508 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.877565 (+    57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:51.877767 (+   202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.878249 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879378 (+  1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.879755 (+   377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879810 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.879843 (+    33us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.879995 (+   152us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.880040 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 13:05:51.880136 18924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.877288 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:35899 (local address 127.3.6.2:42245)
0928 13:05:51.877365 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.877367 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.877468 (+   101us) server_negotiation.cc:407] Connection header received
0928 13:05:51.877512 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.877515 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.877527 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.877603 (+    76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:05:51.877803 (+   200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.878250 (+   447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879390 (+  1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.879767 (+   377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879854 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.879863 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.880029 (+   166us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.880070 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 13:05:51.880153 18934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.877209 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:40369 (local address 127.3.6.1:42585)
0928 13:05:51.877347 (+   138us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.877360 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.877420 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.877594 (+   174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.877595 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.877597 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:51.877677 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.877680 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.878342 (+   662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.878344 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.879282 (+   938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.879284 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.879838 (+   554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879839 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.879911 (+    72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.879914 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.879967 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.880026 (+    59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"mutex_wait_us":100,"spinlock_wait_cycles":15232,"thread_start_us":80,"threads_started":1}
I20260928 13:05:51.880156 18935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.877209 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.3.6.1:35899)
0928 13:05:51.877359 (+   150us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.877371 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:05:51.877456 (+    85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:05:51.877620 (+   164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:05:51.877621 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:05:51.877623 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:05:51.877706 (+    83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.877707 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.878347 (+   640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.878348 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.879281 (+   933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:05:51.879284 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.879883 (+   599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.879884 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:05:51.879935 (+    51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.879939 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:05:51.880013 (+    74us) client_negotiation.cc:240] Negotiation successful
0928 13:05:51.880050 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"mutex_wait_us":19,"thread_start_us":69,"threads_started":1}
I20260928 13:05:51.880651 18862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff4799f3e3b24e219e56a83077458e57" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "143a04b1ba19495686b805d9f2ecc9b4" is_pre_election: true
I20260928 13:05:51.880633 18728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff4799f3e3b24e219e56a83077458e57" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193" is_pre_election: true
I20260928 13:05:51.880811 18728 raft_consensus.cc:2454] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 0.
I20260928 13:05:51.880811 18862 raft_consensus.cc:2454] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 0.
I20260928 13:05:51.881055 18529 leader_election.cc:302] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f8731c5f5134712b77f001cb3abf328, 64556ad65b8a48c29469e2ad55820193; no voters: 
I20260928 13:05:51.881217 18932 raft_consensus.cc:2781] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:05:51.881296 18932 raft_consensus.cc:482] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:05:51.881335 18932 raft_consensus.cc:3037] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:51.882057 18932 raft_consensus.cc:504] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.882220 18932 leader_election.cc:288] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 election: Requested vote from peers 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369), 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245)
I20260928 13:05:51.882400 18862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff4799f3e3b24e219e56a83077458e57" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "143a04b1ba19495686b805d9f2ecc9b4"
I20260928 13:05:51.882475 18862 raft_consensus.cc:3037] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:51.883136 18728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff4799f3e3b24e219e56a83077458e57" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193"
I20260928 13:05:51.883224 18728 raft_consensus.cc:3037] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:05:51.883278 18862 raft_consensus.cc:2454] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 1.
I20260928 13:05:51.883453 18530 leader_election.cc:302] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 143a04b1ba19495686b805d9f2ecc9b4, 5f8731c5f5134712b77f001cb3abf328; no voters: 
I20260928 13:05:51.883559 18932 raft_consensus.cc:2781] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:05:51.883762 18932 raft_consensus.cc:686] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 LEADER]: Becoming Leader. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Running, Role: LEADER
I20260928 13:05:51.883859 18932 consensus_queue.cc:237] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:05:51.884166 18728 raft_consensus.cc:2454] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 1.
I20260928 13:05:51.884670 18449 catalog_manager.cc:5495] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "5f8731c5f5134712b77f001cb3abf328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } health_report { overall_health: UNKNOWN } } }
I20260928 13:05:51.918773 18921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.916162 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41476 (local address 127.3.6.1:36447)
0928 13:05:51.916234 (+    72us) server_negotiation.cc:206] Beginning negotiation
0928 13:05:51.916236 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:05:51.916245 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:05:51.916304 (+    59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:05:51.916305 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:05:51.916325 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:05:51.916387 (+    62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:05:51.916542 (+   155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.917005 (+   463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.917827 (+   822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:05:51.918005 (+   178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:05:51.918055 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:05:51.918384 (+   329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:05:51.918484 (+   100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:05:51.918548 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:05:51.918641 (+    93us) server_negotiation.cc:299] Negotiation successful
0928 13:05:51.918661 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260928 13:05:51.920872 18862 raft_consensus.cc:1261] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Refusing update from remote peer 5f8731c5f5134712b77f001cb3abf328: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:51.920872 18728 raft_consensus.cc:1261] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Refusing update from remote peer 5f8731c5f5134712b77f001cb3abf328: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:05:51.921279 18932 consensus_queue.cc:1035] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:51.921437 18936 consensus_queue.cc:1035] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:05:51.925678 18940 mvcc.cc:205] Tried to move back new op lower bound from 7334300679864336384 to 7334300679716929536. Current Snapshot: MvccSnapshot[applied={T|T < 7334300679864336384 or (T in {7334300679864336384})}]
I20260928 13:05:51.928009 18448 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:51.928138 18448 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:05:51.928912 18448 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Sending DeleteTablet for 3 replicas of tablet ff4799f3e3b24e219e56a83077458e57
I20260928 13:05:51.929287 18708 tablet_service.cc:1514] Processing DeleteTablet for tablet ff4799f3e3b24e219e56a83077458e57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:51 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:44456
I20260928 13:05:51.929327 18574 tablet_service.cc:1514] Processing DeleteTablet for tablet ff4799f3e3b24e219e56a83077458e57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:51 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:41464
I20260928 13:05:51.929332 18842 tablet_service.cc:1514] Processing DeleteTablet for tablet ff4799f3e3b24e219e56a83077458e57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:51 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:51754
I20260928 13:05:51.929567  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18511
I20260928 13:05:51.929582 18949 tablet_replica.cc:330] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: stopping tablet replica
I20260928 13:05:51.930681 18951 tablet_replica.cc:330] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: stopping tablet replica
I20260928 13:05:51.930807 18951 raft_consensus.cc:2229] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:51.930932 18951 raft_consensus.cc:2258] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:51.931617 18951 ts_tablet_manager.cc:1905] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:51.932030 18949 raft_consensus.cc:2229] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:05:51.932200 18949 raft_consensus.cc:2258] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:05:51.932626 18949 ts_tablet_manager.cc:1905] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:05:51.933614 18951 ts_tablet_manager.cc:1918] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:51.933693 18951 log.cc:1196] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/ff4799f3e3b24e219e56a83077458e57
I20260928 13:05:51.933979 18951 ts_tablet_manager.cc:1939] T ff4799f3e3b24e219e56a83077458e57 P 143a04b1ba19495686b805d9f2ecc9b4: Deleting consensus metadata
I20260928 13:05:51.934464 18949 ts_tablet_manager.cc:1918] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:05:51.934533 18949 log.cc:1196] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/ff4799f3e3b24e219e56a83077458e57
I20260928 13:05:51.934573 18436 catalog_manager.cc:4841] TS 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369): tablet ff4799f3e3b24e219e56a83077458e57 (table test-table [id=b250a1943a334554af8f8a0699de1af2]) successfully deleted
I20260928 13:05:51.934790 18949 ts_tablet_manager.cc:1939] T ff4799f3e3b24e219e56a83077458e57 P 64556ad65b8a48c29469e2ad55820193: Deleting consensus metadata
I20260928 13:05:51.935338 18435 catalog_manager.cc:4841] TS 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245): tablet ff4799f3e3b24e219e56a83077458e57 (table test-table [id=b250a1943a334554af8f8a0699de1af2]) successfully deleted
W20260928 13:05:51.936703 18436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:36447 (error 108)
I20260928 13:05:51.936956  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18645
I20260928 13:05:51.937775 18919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:05:51.937136 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36447 (local address 127.0.0.1:41484)
0928 13:05:51.937688 (+   552us) negotiation.cc:107] Waiting for socket to connect
0928 13:05:51.937731 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":528}
W20260928 13:05:51.938512 18436 catalog_manager.cc:4584] TS 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ff4799f3e3b24e219e56a83077458e57: Network error: Client connection negotiation failed: client connection to 127.3.6.1:36447: connect: Connection refused (error 111)
I20260928 13:05:51.942229  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18779
I20260928 13:05:51.947541  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18417
I20260928 13:06:11.953727  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--webserver_interface=127.3.6.62
--webserver_port=34515
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:41275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:12.034880 18953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:12.035127 18953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:12.035151 18953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:12.036346 18953 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 13:06:12.036391 18953 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 13:06:12.036403 18953 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 13:06:12.036415 18953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:12.036428 18953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:12.036482 18953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:12.036501 18953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:12.036525 18953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:12.038028 18953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:41275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=34515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:12.038306 18953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:12.038570 18953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:12.047315 18960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.047361 18959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.047329 18962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.047737 18953 server_base.cc:1034] running on GCE node
I20260928 13:06:12.048030 18953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:12.048393 18953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:12.049561 18953 hybrid_clock.cc:648] HybridClock initialized: now 1790600772049548 us; error 27 us; skew 500 ppm
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:12.056279 18953 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:06:12.056815 18953 webserver.cc:460] Webserver started at http://127.3.6.62:34515/ using document root <none> and password file <none>
I20260928 13:06:12.057080 18953 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:12.057180 18953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:12.058645 18953 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.059379 18969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.059669 18953 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:06:12.059813 18953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "6c3990e512c74a68bcdb98be4323f9ef"
format_stamp: "Formatted at 2026-09-28 13:05:50 on dist-test-slave-ddvw"
server_key: "82c153a05d50edb9ce37c202578e94d5"
server_key_iv: "80d2da05490c65bf44acf3bc9913960f"
server_key_version: "encryptionkey@0"
I20260928 13:06:12.060277 18953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:12.073654 18953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:12.075618 18953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:12.075815 18953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:12.079963 18953 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:41275
I20260928 13:06:12.080000 19021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:41275 every 8 connection(s)
I20260928 13:06:12.080382 18953 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:12.081804 19022 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:06:12.082389 19022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap starting.
I20260928 13:06:12.089021  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 18953
I20260928 13:06:12.089425  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:36447
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=34693
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:06:12.091135 19022 log.cc:824] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:12.093194 19022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:12.093479 19022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap complete.
I20260928 13:06:12.095844 19022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:12.096066 19022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Initialized, Role: FOLLOWER
I20260928 13:06:12.096230 19022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:12.096312 19022 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:12.096393 19022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:12.096457 19022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:06:12.097463 19022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:12.097576 19022 leader_election.cc:302] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c3990e512c74a68bcdb98be4323f9ef; no voters: 
I20260928 13:06:12.097764 19022 leader_election.cc:288] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260928 13:06:12.097798 19026 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Leader election won for term 2
I20260928 13:06:12.097908 19026 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 LEADER]: Becoming Leader. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Running, Role: LEADER
I20260928 13:06:12.097991 19026 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:12.098032 19022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:12.098265 19027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:06:12.098352 19027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:12.098260 19026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3990e512c74a68bcdb98be4323f9ef. Latest consensus state: current_term: 2 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:06:12.098546 19026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:12.098673 19030 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:12.099512 19030 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:12.099617 19030 catalog_manager.cc:1259] Loaded cluster ID: 36b9e72e6e5941e0b465b51d8a875b40
I20260928 13:06:12.099654 19030 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:12.100780 19030 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:12.100955 19030 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Loaded TSK: 0
I20260928 13:06:12.114852 19030 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Generated new TSK 1
I20260928 13:06:12.114961 19030 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 13:06:12.175036 19024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:12.175274 19024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:12.175311 19024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:12.176465 19024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:12.176532 19024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:12.176582 19024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:12.178021 19024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:36447
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=34693
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:12.178282 19024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:12.178514 19024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:12.183553 19049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.183537 19052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.183549 19050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.183738 19024 server_base.cc:1034] running on GCE node
I20260928 13:06:12.183951 19024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:12.184219 19024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:12.185415 19024 hybrid_clock.cc:648] HybridClock initialized: now 1790600772185386 us; error 42 us; skew 500 ppm
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:12.188311 19024 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:06:12.188783 19024 webserver.cc:460] Webserver started at http://127.3.6.1:34693/ using document root <none> and password file <none>
I20260928 13:06:12.189019 19024 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:12.189098 19024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:12.190533 19024 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.191272 19059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.191464 19024 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.191563 19024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "5f8731c5f5134712b77f001cb3abf328"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "845af5934f2c9283c06c79b8110a65f6"
server_key_iv: "e0e058a50663b3d636fe866072b45c12"
server_key_version: "encryptionkey@0"
I20260928 13:06:12.191911 19024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:12.203718 19024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:12.206106 19024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:12.206300 19024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:12.206532 19024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:12.206943 19066 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 13:06:12.208853 19024 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 13:06:12.208915 19024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260928 13:06:12.208962 19024 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 13:06:12.209595 19024 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 13:06:12.209650 19024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:06:12.209718 19066 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Bootstrap starting.
I20260928 13:06:12.216921 19024 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:36447
I20260928 13:06:12.216957 19173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:36447 every 8 connection(s)
I20260928 13:06:12.217346 19024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:12.220515 19066 log.cc:824] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:12.223171 19066 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:12.223486 19066 tablet_bootstrap.cc:492] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Bootstrap complete.
I20260928 13:06:12.224648 19066 ts_tablet_manager.cc:1397] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260928 13:06:12.225031  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19024
I20260928 13:06:12.225349  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:42245
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=33873
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:06:12.225927 19066 raft_consensus.cc:348] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:06:12.226621 19066 raft_consensus.cc:729] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Initialized, Role: FOLLOWER
I20260928 13:06:12.226778 19066 consensus_queue.cc:260] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } }
I20260928 13:06:12.227064 19066 ts_tablet_manager.cc:1428] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.001s
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:12.233404 19176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.218091 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:58883)
0928 13:06:12.220803 (+  2712us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.220851 (+    48us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.221370 (+   519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.221930 (+   560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.221934 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.222264 (+   330us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:12.222449 (+   185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.222455 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.223790 (+  1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.223791 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.224605 (+   814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.224608 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.225582 (+   974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.225610 (+    28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.225764 (+   154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.226403 (+   639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:12.226413 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:12.228598 (+  2185us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:12.231267 (+  2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.231275 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.231278 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.231615 (+   337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.231930 (+   315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.231931 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.231932 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.232073 (+   141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.232612 (+   539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:12.232619 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:12.232789 (+   170us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.232908 (+   119us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.233120 (+   212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2663,"thread_start_us":96,"threads_started":1}
I20260928 13:06:12.234565 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.218151 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:58883 (local address 127.3.6.62:41275)
0928 13:06:12.221547 (+  3396us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.221555 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.221584 (+    29us) server_negotiation.cc:407] Connection header received
0928 13:06:12.221688 (+   104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.221692 (+     4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.221760 (+    68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.221902 (+   142us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.222585 (+   683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.223662 (+  1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.224702 (+  1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.225388 (+   686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.225502 (+   114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.228737 (+  3235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.228742 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.228742 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.228757 (+    15us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.231149 (+  2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.231717 (+   568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.231721 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.231721 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.231848 (+   127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.232155 (+   307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.232156 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.232157 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.232494 (+   337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.232580 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.234147 (+  1567us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.234321 (+   174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3346,"thread_start_us":66,"threads_started":1}
I20260928 13:06:12.235844 19174 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:06:12.235947 19174 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:12.236125 19174 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:06:12.236912 18986 ts_manager.cc:194] Registered new tserver with Master: 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447)
I20260928 13:06:12.238209 18986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:58883
I20260928 13:06:12.239172 19174 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:06:12.247231 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.237867 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35230 (local address 127.3.6.1:36447)
0928 13:06:12.238295 (+   428us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.238299 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.238309 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:12.238341 (+    32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.238350 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.238364 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.238425 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.239142 (+   717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.240278 (+  1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.241384 (+  1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.241836 (+   452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.241897 (+    61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.244211 (+  2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.244217 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.244218 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.244224 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.245930 (+  1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.246363 (+   433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.246365 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.246366 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.246418 (+    52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.246603 (+   185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.246604 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.246604 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.246755 (+   151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.246819 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.247058 (+   239us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.247162 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":92,"threads_started":1}
I20260928 13:06:12.247239 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.237597 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36447 (local address 127.0.0.1:35230)
0928 13:06:12.238044 (+   447us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.238076 (+    32us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.238155 (+    79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.238663 (+   508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.238668 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.238968 (+   300us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:12.239055 (+    87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.239058 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.240360 (+  1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.240361 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.241287 (+   926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.241289 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.241904 (+   615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.241907 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.241971 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.242532 (+   561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:12.242536 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:12.244123 (+  1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:12.246005 (+  1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.246011 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.246013 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.246284 (+   271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.246480 (+   196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.246481 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.246481 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.246547 (+    66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.246821 (+   274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:12.246828 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:12.246886 (+    58us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.246977 (+    91us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.247121 (+   144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":89,"threads_started":1}
I20260928 13:06:12.247822 19092 tablet_service.cc:1514] Processing DeleteTablet for tablet ff4799f3e3b24e219e56a83077458e57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:05:51 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:35230
I20260928 13:06:12.248457 19183 tablet_replica.cc:330] stopping tablet replica
I20260928 13:06:12.248571 19183 raft_consensus.cc:2229] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:12.248646 19183 raft_consensus.cc:2258] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:12.248952 19183 ts_tablet_manager.cc:1905] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:12.251199 19183 ts_tablet_manager.cc:1918] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:12.251289 19183 log.cc:1196] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal/wals/ff4799f3e3b24e219e56a83077458e57
I20260928 13:06:12.251523 19183 ts_tablet_manager.cc:1939] T ff4799f3e3b24e219e56a83077458e57 P 5f8731c5f5134712b77f001cb3abf328: Deleting consensus metadata
I20260928 13:06:12.252063 18973 catalog_manager.cc:4841] TS 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447): tablet ff4799f3e3b24e219e56a83077458e57 (table test-table [id=b250a1943a334554af8f8a0699de1af2]) successfully deleted
W20260928 13:06:12.315410 19179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:12.315659 19179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:12.315696 19179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:12.316864 19179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:12.316933 19179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:12.316979 19179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:12.318445 19179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:42245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=33873
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:12.318722 19179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:12.318956 19179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:12.324064 19189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.324030 19191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.324155 19179 server_base.cc:1034] running on GCE node
W20260928 13:06:12.324050 19188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.324497 19179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:12.324781 19179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:12.325969 19179 hybrid_clock.cc:648] HybridClock initialized: now 1790600772325965 us; error 41 us; skew 500 ppm
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:12.328701 19179 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:06:12.329185 19179 webserver.cc:460] Webserver started at http://127.3.6.2:33873/ using document root <none> and password file <none>
I20260928 13:06:12.329419 19179 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:12.329500 19179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:12.330933 19179 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:12.331604 19198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.331789 19179 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.331897 19179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "64556ad65b8a48c29469e2ad55820193"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "73359d82bda88cd676e6fc5506f15920"
server_key_iv: "5fd69b132e1123f6f89aa9b0f3ebcf76"
server_key_version: "encryptionkey@0"
I20260928 13:06:12.332293 19179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:12.340050 19179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:12.342137 19179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:12.342307 19179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:12.342572 19179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:12.342895 19179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:12.342947 19179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.342989 19179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:12.343044 19179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.349121 19179 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42245
I20260928 13:06:12.349176 19311 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42245 every 8 connection(s)
I20260928 13:06:12.349521 19179 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:12.351492  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19179
I20260928 13:06:12.351809  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:40369
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=41227
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:12.359428 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.350201 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:53757 (local address 127.3.6.62:41275)
0928 13:06:12.350267 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.350269 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.350525 (+   256us) server_negotiation.cc:407] Connection header received
0928 13:06:12.351105 (+   580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.351106 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.351123 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.351185 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.352317 (+  1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.352831 (+   514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.353860 (+  1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.354079 (+   219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.354185 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.356484 (+  2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.356485 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.356485 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.356494 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.357957 (+  1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.358381 (+   424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.358383 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.358383 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.358445 (+    62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.358695 (+   250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.358696 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.358697 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.358822 (+   125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.358899 (+    77us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.359238 (+   339us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.359335 (+    97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:06:12.359670 19314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.350214 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:53757)
0928 13:06:12.350368 (+   154us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.350429 (+    61us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.350953 (+   524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.351265 (+   312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.351269 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.351961 (+   692us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:12.352205 (+   244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.352212 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.352934 (+   722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.352935 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.353751 (+   816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.353753 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.354182 (+   429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.354195 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.354327 (+   132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.354925 (+   598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:12.354937 (+    12us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:12.356376 (+  1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:12.358060 (+  1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.358067 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.358069 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.358304 (+   235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.358511 (+   207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.358513 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.358513 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.358628 (+   115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.358891 (+   263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:12.358898 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:12.359098 (+   200us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.359216 (+   118us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.359392 (+   176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260928 13:06:12.360194 19312 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:06:12.360309 19312 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:12.360529 19312 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:06:12.360950 18986 ts_manager.cc:194] Registered new tserver with Master: 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245)
I20260928 13:06:12.361532 18986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:53757
W20260928 13:06:12.434015 19315 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:12.434211 19315 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:12.434242 19315 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:12.435429 19315 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:12.435472 19315 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:12.435498 19315 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:12.436975 19315 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:40369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=41227
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19315
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:12.437155 19315 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:12.437330 19315 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:12.442162 19321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:12.442169 19320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.442396 19315 server_base.cc:1034] running on GCE node
W20260928 13:06:12.442402 19323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:12.442636 19315 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:12.442889 19315 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:12.444074 19315 hybrid_clock.cc:648] HybridClock initialized: now 1790600772444061 us; error 41 us; skew 500 ppm
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:12.446677 19315 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:06:12.447299 19315 webserver.cc:460] Webserver started at http://127.3.6.3:41227/ using document root <none> and password file <none>
I20260928 13:06:12.447556 19315 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:12.447639 19315 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:12.449011 19315 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.449709 19330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.450043 19315 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.450150 19315 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "143a04b1ba19495686b805d9f2ecc9b4"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "abc8f221cba1b59472e85d17176e24a9"
server_key_iv: "e4153edbd3f23d9f1b77eff071551caa"
server_key_version: "encryptionkey@0"
I20260928 13:06:12.450527 19315 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:12.476191 19315 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:12.478262 19315 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:12.478430 19315 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:12.478679 19315 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:12.479060 19315 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:12.479104 19315 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.479146 19315 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:12.479172 19315 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:12.484982 19315 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:40369
I20260928 13:06:12.485024 19443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:40369 every 8 connection(s)
I20260928 13:06:12.485396 19315 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:12.486778  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19315
Sep 28 13:06:12 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600772, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:12.495081 19448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.487218 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60838 (local address 127.3.6.62:41275)
0928 13:06:12.487365 (+   147us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.487367 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.487458 (+    91us) server_negotiation.cc:407] Connection header received
0928 13:06:12.487540 (+    82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.487541 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.487549 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.487601 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.488867 (+  1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.489295 (+   428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.490291 (+   996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.490510 (+   219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.490556 (+    46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.491925 (+  1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.491926 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.491926 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.491933 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.493631 (+  1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.494151 (+   520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.494152 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.494153 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.494241 (+    88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.494466 (+   225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.494467 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.494468 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.494607 (+   139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.494794 (+   187us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.494835 (+    41us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.494921 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260928 13:06:12.496016 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.486157 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:43775 (local address 127.3.6.62:41275)
0928 13:06:12.486220 (+    63us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.486222 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.486428 (+   206us) server_negotiation.cc:407] Connection header received
0928 13:06:12.486910 (+   482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.486912 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.486925 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.486992 (+    67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.488308 (+  1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.488794 (+   486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.490045 (+  1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.490270 (+   225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.490341 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.492835 (+  2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.492836 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.492837 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.492844 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.494437 (+  1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.494916 (+   479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.494917 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.494917 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.494972 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.495366 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.495366 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.495367 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.495498 (+   131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.495556 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.495883 (+   327us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.495958 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:06:12.496287 19446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.486159 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:43775)
0928 13:06:12.486308 (+   149us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.486341 (+    33us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.486806 (+   465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.487086 (+   280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.487090 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.487934 (+   844us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:12.488231 (+   297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.488237 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.488870 (+   633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.488871 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.489964 (+  1093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.489967 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.490349 (+   382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.490358 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.490460 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.490974 (+   514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:12.490983 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:12.492735 (+  1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:12.494515 (+  1780us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.494522 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.494524 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.494838 (+   314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.495068 (+   230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:12.495068 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:12.495069 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:12.495214 (+   145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:12.495568 (+   354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:12.495575 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:12.495732 (+   157us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.495860 (+   128us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.496028 (+   168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":70,"threads_started":1}
I20260928 13:06:12.496768 19444 heartbeater.cc:347] Connected to a master server at 127.3.6.62:41275
I20260928 13:06:12.496881 19444 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:12.497015 19444 heartbeater.cc:511] Master 127.3.6.62:41275 requested a full tablet report, sending...
I20260928 13:06:12.497370 18986 ts_manager.cc:194] Registered new tserver with Master: 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
I20260928 13:06:12.497746 18986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:43775
I20260928 13:06:12.506762  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:12.509449 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.507133 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60840 (local address 127.3.6.62:41275)
0928 13:06:12.507198 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.507200 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.507327 (+   127us) server_negotiation.cc:407] Connection header received
0928 13:06:12.507378 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.507379 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.507412 (+    33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.507479 (+    67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:12.507573 (+    94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.508036 (+   463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.508766 (+   730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.508953 (+   187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.509010 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.509185 (+   175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:12.509229 (+    44us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0928 13:06:12.509393 (+   164us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60840: token expired
Metrics: {"server-negotiator.queue_time_us":41}
W20260928 13:06:12.509536 19177 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60840: token expired
W20260928 13:06:12.509912 18912 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.3.6.62:41275)
I20260928 13:06:12.517978 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.510208 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60852 (local address 127.3.6.62:41275)
0928 13:06:12.510243 (+    35us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.510284 (+    41us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.510294 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:12.510323 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.510324 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.510334 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.510400 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:12.511189 (+   789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.511975 (+   786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.513036 (+  1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.513382 (+   346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.513477 (+    95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.515077 (+  1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:12.515078 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:12.515078 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:12.515085 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:12.516739 (+  1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.517127 (+   388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.517128 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.517129 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.517190 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:12.517429 (+   239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:12.517430 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:12.517430 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:12.517562 (+   132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:12.517678 (+   116us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.517813 (+   135us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.517891 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:06:12.519196 18986 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:12.521008 18986 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:12.523343 19092 tablet_service.cc:1467] Processing CreateTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d (DEFAULT_TABLE table=test-table [id=865c077708eb4b2b95c010127b7bd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:12.523556 19092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d423fd131c94bb0a7b157cb5decba1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:12.525132 19066 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Bootstrap starting.
I20260928 13:06:12.525424 19066 tablet_bootstrap.cc:654] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:12.526438 19066 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: No bootstrap required, opened a new log
I20260928 13:06:12.526494 19066 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:12.526638 19066 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.526712 19066 raft_consensus.cc:374] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:12.526767 19066 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Initialized, Role: FOLLOWER
I20260928 13:06:12.526813 19066 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.526933 19066 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Time spent starting tablet: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:12.527158 19450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.522874 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:40369 (local address 127.0.0.1:53980)
0928 13:06:12.523082 (+   208us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.523093 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.523157 (+    64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.523508 (+   351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.523509 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.523513 (+     4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:12.523561 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.523564 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.524847 (+  1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.524848 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.525977 (+  1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.525981 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.526883 (+   902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.526885 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.526950 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.526974 (+    24us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.527009 (+    35us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.527081 (+    72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":19,"thread_start_us":132,"threads_started":1}
I20260928 13:06:12.527278 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.522871 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.0.0.1:44656)
0928 13:06:12.522927 (+    56us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.522938 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.522978 (+    40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.523769 (+   791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.523770 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.523771 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:12.523817 (+    46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.523819 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.524823 (+  1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.524824 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.525849 (+  1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.525858 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.526892 (+  1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.526893 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.526954 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.526976 (+    22us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.527173 (+   197us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.527221 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":38}
I20260928 13:06:12.527621 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.523088 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53980 (local address 127.3.6.3:40369)
0928 13:06:12.523306 (+   218us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.523311 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.523322 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:12.523365 (+    43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.523367 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.523384 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.523641 (+   257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:12.523734 (+    93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.524742 (+  1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.526076 (+  1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.526782 (+   706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.527386 (+   604us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.527458 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.527489 (+    31us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.527538 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":90,"threads_started":1}
I20260928 13:06:12.528618 19378 tablet_service.cc:1467] Processing CreateTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d (DEFAULT_TABLE table=test-table [id=865c077708eb4b2b95c010127b7bd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:12.528985 19378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d423fd131c94bb0a7b157cb5decba1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:12.529032 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.523241 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.3.6.2:42245)
0928 13:06:12.523507 (+   266us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.523512 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.523523 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:12.523562 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.523565 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.523580 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.523955 (+   375us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:12.524047 (+    92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.524726 (+   679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.525935 (+  1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.526784 (+   849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.526893 (+   109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.526963 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.528895 (+  1932us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.528942 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":129,"threads_started":1}
I20260928 13:06:12.529762 19246 tablet_service.cc:1467] Processing CreateTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d (DEFAULT_TABLE table=test-table [id=865c077708eb4b2b95c010127b7bd016]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:12.530099 19246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d423fd131c94bb0a7b157cb5decba1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:12.533474 19454 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Bootstrap starting.
I20260928 13:06:12.533797 19455 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Bootstrap starting.
I20260928 13:06:12.534359 19454 tablet_bootstrap.cc:654] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:12.534399 19455 tablet_bootstrap.cc:654] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:12.534840 19454 log.cc:824] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:12.534878 19455 log.cc:824] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:12.535877 19455 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: No bootstrap required, opened a new log
I20260928 13:06:12.535878 19454 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: No bootstrap required, opened a new log
I20260928 13:06:12.535948 19454 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260928 13:06:12.535948 19455 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260928 13:06:12.537915 19454 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.538049 19454 raft_consensus.cc:374] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:12.538072 19454 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 143a04b1ba19495686b805d9f2ecc9b4, State: Initialized, Role: FOLLOWER
I20260928 13:06:12.538189 19454 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.538331 19455 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.538467 19454 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:06:12.538501 19444 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
I20260928 13:06:12.538503 19455 raft_consensus.cc:374] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:12.538542 19455 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64556ad65b8a48c29469e2ad55820193, State: Initialized, Role: FOLLOWER
I20260928 13:06:12.538645 19455 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.538908 19312 heartbeater.cc:503] Master 127.3.6.62:41275 was elected leader, sending a full tablet report...
I20260928 13:06:12.539350 19455 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
W20260928 13:06:12.600099 19313 tablet.cc:2369] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:06:12.661546 19180 raft_consensus.cc:482] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:12.661752 19180 raft_consensus.cc:504] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.662106 19180 leader_election.cc:288] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245), 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
I20260928 13:06:12.665320 19452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.662444 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:38789 (local address 127.3.6.2:42245)
0928 13:06:12.662536 (+    92us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.662539 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.662547 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:06:12.662579 (+    32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.662580 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.662594 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.662678 (+    84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:12.662858 (+   180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.663480 (+   622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.664553 (+  1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.664937 (+   384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.665023 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.665034 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.665195 (+   161us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.665234 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260928 13:06:12.665333 19451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.662436 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:59671 (local address 127.3.6.3:40369)
0928 13:06:12.662501 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.662503 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.662692 (+   189us) server_negotiation.cc:407] Connection header received
0928 13:06:12.662752 (+    60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.662753 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.662764 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.662817 (+    53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:12.662963 (+   146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.663542 (+   579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.664526 (+   984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.664922 (+   396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.665008 (+    86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.665022 (+    14us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.665209 (+   187us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.665258 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 13:06:12.665371 19176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.662329 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.3.6.1:38789)
0928 13:06:12.662411 (+    82us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.662425 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.662485 (+    60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.662699 (+   214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.662701 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.662704 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:12.662780 (+    76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.662782 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.663565 (+   783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.663566 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.664462 (+   896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.664464 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.665025 (+   561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.665026 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.665118 (+    92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.665121 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.665188 (+    67us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.665239 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":38}
I20260928 13:06:12.665380 19460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.662331 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:40369 (local address 127.3.6.1:59671)
0928 13:06:12.662620 (+   289us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.662632 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:12.662697 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:12.662818 (+   121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:12.662819 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:12.662820 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:12.662893 (+    73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.662895 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.663632 (+   737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.663633 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.664433 (+   800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:12.664435 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.665029 (+   594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.665030 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:12.665101 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.665120 (+    19us) client_negotiation.cc:769] Sending connection context
0928 13:06:12.665200 (+    80us) client_negotiation.cc:240] Negotiation successful
0928 13:06:12.665245 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":135,"thread_start_us":102,"threads_started":1}
I20260928 13:06:12.665807 19398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "143a04b1ba19495686b805d9f2ecc9b4" is_pre_election: true
I20260928 13:06:12.665782 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193" is_pre_election: true
I20260928 13:06:12.665954 19266 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 0.
I20260928 13:06:12.665953 19398 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 0.
I20260928 13:06:12.666217 19063 leader_election.cc:302] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 143a04b1ba19495686b805d9f2ecc9b4, 5f8731c5f5134712b77f001cb3abf328; no voters: 
I20260928 13:06:12.666392 19180 raft_consensus.cc:2781] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:12.666453 19180 raft_consensus.cc:482] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:12.666498 19180 raft_consensus.cc:3037] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:12.667269 19180 raft_consensus.cc:504] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.667418 19180 leader_election.cc:288] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 election: Requested vote from peers 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245), 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
I20260928 13:06:12.667598 19398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "143a04b1ba19495686b805d9f2ecc9b4"
I20260928 13:06:12.667596 19266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193"
I20260928 13:06:12.667681 19398 raft_consensus.cc:3037] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:12.667681 19266 raft_consensus.cc:3037] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:12.668591 19266 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 1.
I20260928 13:06:12.668591 19398 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 1.
I20260928 13:06:12.668780 19062 leader_election.cc:302] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f8731c5f5134712b77f001cb3abf328, 64556ad65b8a48c29469e2ad55820193; no voters: 
I20260928 13:06:12.668872 19180 raft_consensus.cc:2781] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:12.669020 19180 raft_consensus.cc:686] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 LEADER]: Becoming Leader. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Running, Role: LEADER
I20260928 13:06:12.669132 19180 consensus_queue.cc:237] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:12.669952 18986 catalog_manager.cc:5495] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "5f8731c5f5134712b77f001cb3abf328" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } health_report { overall_health: HEALTHY } } }
I20260928 13:06:12.710745 19182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.708348 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35240 (local address 127.3.6.1:36447)
0928 13:06:12.708416 (+    68us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:12.708418 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:12.708432 (+    14us) server_negotiation.cc:407] Connection header received
0928 13:06:12.708467 (+    35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:12.708467 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:12.708487 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:12.708569 (+    82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:12.708710 (+   141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.709215 (+   505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.709953 (+   738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:12.710160 (+   207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:12.710239 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:12.710405 (+   166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:12.710506 (+   101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:12.710592 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:12.710633 (+    41us) server_negotiation.cc:299] Negotiation successful
0928 13:06:12.710656 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:06:12.712369 19266 raft_consensus.cc:1261] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Refusing update from remote peer 5f8731c5f5134712b77f001cb3abf328: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:12.712369 19398 raft_consensus.cc:1261] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Refusing update from remote peer 5f8731c5f5134712b77f001cb3abf328: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:12.712764 19180 consensus_queue.cc:1035] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:12.712939 19461 consensus_queue.cc:1035] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:12.717350 19464 mvcc.cc:205] Tried to move back new op lower bound from 7334300765027110912 to 7334300764853325824. Current Snapshot: MvccSnapshot[applied={T|T < 7334300765027110912 or (T in {7334300765027110912})}]
I20260928 13:06:12.717566 18985 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:12.717651 18985 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:12.718374 18985 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Sending DeleteTablet for 3 replicas of tablet 4d423fd131c94bb0a7b157cb5decba1d
I20260928 13:06:12.718681 19092 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:12 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:35230
I20260928 13:06:12.718674 19246 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:12 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:44656
I20260928 13:06:12.718693 19378 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d423fd131c94bb0a7b157cb5decba1d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:12 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:53980
I20260928 13:06:12.718787 19183 tablet_replica.cc:330] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: stopping tablet replica
I20260928 13:06:12.718843 19183 raft_consensus.cc:2229] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:12.718883 19473 tablet_replica.cc:330] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: stopping tablet replica
I20260928 13:06:12.718918 19183 raft_consensus.cc:2258] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:12.718967 19473 raft_consensus.cc:2229] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:12.719086 19473 raft_consensus.cc:2258] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:12.719215  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19024
I20260928 13:06:12.719353 19183 ts_tablet_manager.cc:1905] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:12.720474 19473 ts_tablet_manager.cc:1905] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:12.722246 19473 ts_tablet_manager.cc:1918] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:12.722317 19473 log.cc:1196] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/4d423fd131c94bb0a7b157cb5decba1d
I20260928 13:06:12.722576 19473 ts_tablet_manager.cc:1939] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Deleting consensus metadata
I20260928 13:06:12.722991 18973 catalog_manager.cc:4841] TS 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369): tablet 4d423fd131c94bb0a7b157cb5decba1d (table test-table [id=865c077708eb4b2b95c010127b7bd016]) successfully deleted
W20260928 13:06:12.725283 18973 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:36447 (error 108)
I20260928 13:06:12.725442 19474 tablet_replica.cc:330] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: stopping tablet replica
I20260928 13:06:12.725556 19474 raft_consensus.cc:2229] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:12.725644  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19179
I20260928 13:06:12.725682 19474 raft_consensus.cc:2258] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:12.726315 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.725710 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36447 (local address 127.0.0.1:35248)
0928 13:06:12.726222 (+   512us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.726275 (+    53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491}
W20260928 13:06:12.727434 18973 catalog_manager.cc:4584] TS 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d423fd131c94bb0a7b157cb5decba1d: Network error: Client connection negotiation failed: client connection to 127.3.6.1:36447: connect: Connection refused (error 111)
I20260928 13:06:12.730834  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19315
I20260928 13:06:12.730850 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:12.730733 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.0.0.1:44664)
0928 13:06:12.730795 (+    62us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:12.730822 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:42245: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:06:12.735262  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 18953
I20260928 13:06:32.740720  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--webserver_interface=127.3.6.62
--webserver_port=34515
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:41275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:32.820858 19476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:32.821074 19476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:32.821096 19476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:32.822245 19476 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 13:06:32.822285 19476 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 13:06:32.822299 19476 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 13:06:32.822346 19476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:32.822371 19476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:32.822397 19476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:32.822422 19476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:32.822449 19476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:32.823921 19476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:41275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:41275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=34515
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:32.824183 19476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:32.824411 19476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:32.829293 19481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:32.829332 19482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:32.829335 19476 server_base.cc:1034] running on GCE node
W20260928 13:06:32.829334 19484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:32.829782 19476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:32.830070 19476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:32.831226 19476 hybrid_clock.cc:648] HybridClock initialized: now 1790600792831218 us; error 33 us; skew 500 ppm
Sep 28 13:06:32 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600792, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:32.833583 19476 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:06:32.833997 19476 webserver.cc:460] Webserver started at http://127.3.6.62:34515/ using document root <none> and password file <none>
I20260928 13:06:32.834208 19476 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:32.834272 19476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:32.835655 19476 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:32.836247 19491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:32.836405 19476 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:32.836534 19476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "6c3990e512c74a68bcdb98be4323f9ef"
format_stamp: "Formatted at 2026-09-28 13:05:50 on dist-test-slave-ddvw"
server_key: "82c153a05d50edb9ce37c202578e94d5"
server_key_iv: "80d2da05490c65bf44acf3bc9913960f"
server_key_version: "encryptionkey@0"
I20260928 13:06:32.836863 19476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:32.851966 19476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:32.853808 19476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:32.853971 19476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:32.858009 19476 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:41275
I20260928 13:06:32.858042 19543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:41275 every 8 connection(s)
I20260928 13:06:32.858443 19476 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:32.859956 19544 sys_catalog.cc:263] Verifying existing consensus state
I20260928 13:06:32.860709 19544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap starting.
I20260928 13:06:32.865571  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19476
I20260928 13:06:32.865922  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:36447
--local_ip_for_outbound_sockets=127.3.6.1
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=34693
--webserver_interface=127.3.6.1
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:06:32.870093 19544 log.cc:824] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:32.872406 19544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:32.872737 19544 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Bootstrap complete.
I20260928 13:06:32.875068 19544 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:32.875363 19544 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Initialized, Role: FOLLOWER
I20260928 13:06:32.875555 19544 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:32.875615 19544 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:32.875677 19544 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:32.875731 19544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 2 FOLLOWER]: Advancing to term 3
I20260928 13:06:32.876776 19544 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:32.876890 19544 leader_election.cc:302] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c3990e512c74a68bcdb98be4323f9ef; no voters: 
I20260928 13:06:32.877087 19544 leader_election.cc:288] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [CANDIDATE]: Term 3 election: Requested vote from peers 
I20260928 13:06:32.877131 19548 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 3 FOLLOWER]: Leader election won for term 3
I20260928 13:06:32.877300 19548 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [term 3 LEADER]: Becoming Leader. State: Replica: 6c3990e512c74a68bcdb98be4323f9ef, State: Running, Role: LEADER
I20260928 13:06:32.877381 19544 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:32.877461 19548 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } }
I20260928 13:06:32.877828 19548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c3990e512c74a68bcdb98be4323f9ef. Latest consensus state: current_term: 3 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:06:32.877996 19548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:32.877831 19550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "6c3990e512c74a68bcdb98be4323f9ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c3990e512c74a68bcdb98be4323f9ef" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 41275 } } }
I20260928 13:06:32.878203 19550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:32.878285 19557 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:32.879233 19557 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:32.879396 19557 catalog_manager.cc:1259] Loaded cluster ID: 36b9e72e6e5941e0b465b51d8a875b40
I20260928 13:06:32.879572 19557 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:32.880746 19557 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:32.880923 19557 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Loaded TSK: 0
I20260928 13:06:32.880975 19557 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6c3990e512c74a68bcdb98be4323f9ef: Loaded TSK: 1
F20260928 13:06:32.881203 19557 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
    @     0x7fd7740709ad  google::LogMessage::Fail() at ??:0
    @     0x7fd77407388a  google::LogMessage::SendToLog() at ??:0
    @     0x7fd7740704de  google::LogMessage::Flush() at ??:0
    @     0x7fd774071a19  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7fd7767dd104  kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
    @     0x7fd7767dad41  kudu::security::TokenSigner::ImportKeys() at ??:0
    @     0x7fd77bfca1cd  kudu::master::CatalogManager::LoadTskEntries() at ??:0
    @     0x7fd77bfca48e  kudu::master::CatalogManager::InitTokenSigner() at ??:0
    @     0x7fd77bfca594  _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
    @     0x7fd77bf90c48  _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
    @     0x7fd77bf9aad0  kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
    @     0x7fd775f3e0d3  kudu::ThreadPool::DispatchThread() at ??:0
    @     0x7fd775f33954  kudu::Thread::SuperviseThread() at ??:0
    @     0x7fd776d976db  start_thread at ??:0
    @     0x7fd772b6e61f  clone at ??:0
W20260928 13:06:32.958796 19546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:32.959041 19546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:32.959084 19546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:32.960258 19546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:32.960323 19546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:32.960371 19546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:32.961884 19546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:36447
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=34693
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19546
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:32.962152 19546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:32.962376 19546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:32.968322 19586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:32.968339 19588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:32.968562 19546 server_base.cc:1034] running on GCE node
W20260928 13:06:32.968632 19585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:32.968868 19546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:32.969116 19546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:32.970273 19546 hybrid_clock.cc:648] HybridClock initialized: now 1790600792970246 us; error 44 us; skew 500 ppm
Sep 28 13:06:32 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600792, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:32.972842 19546 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:06:32.973317 19546 webserver.cc:460] Webserver started at http://127.3.6.1:34693/ using document root <none> and password file <none>
I20260928 13:06:32.973555 19546 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:32.973623 19546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:32.975080 19546 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:32.975863 19595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:32.976033 19546 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:32.976145 19546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "5f8731c5f5134712b77f001cb3abf328"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "845af5934f2c9283c06c79b8110a65f6"
server_key_iv: "e0e058a50663b3d636fe866072b45c12"
server_key_version: "encryptionkey@0"
I20260928 13:06:32.976506 19546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:33.006886 19546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:33.009204 19546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:33.009380 19546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:33.009624 19546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:33.010077 19602 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 13:06:33.012038 19546 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 13:06:33.012104 19546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260928 13:06:33.012147 19546 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 13:06:33.012753 19546 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 13:06:33.012806 19546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:06:33.012898 19602 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Bootstrap starting.
I20260928 13:06:33.014969 19602 log.cc:824] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:33.018033 19602 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:33.018335 19602 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Bootstrap complete.
I20260928 13:06:33.018498 19602 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.002s
I20260928 13:06:33.019915 19546 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:36447
I20260928 13:06:33.019963 19710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:36447 every 8 connection(s)
I20260928 13:06:33.020264 19546 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:33.020318 19602 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:33.020809 19602 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Initialized, Role: FOLLOWER
I20260928 13:06:33.020953 19602 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:33.021322 19602 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:33.021613  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19546
I20260928 13:06:33.021931  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:42245
--local_ip_for_outbound_sockets=127.3.6.2
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=33873
--webserver_interface=127.3.6.2
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:33.108175 19714 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:06:33.021287 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:59793)
0928 13:06:33.021519 (+   232us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.021565 (+    46us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:33.021731 (+   166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:33.107957 (+ 86226us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":80,"threads_started":1}
W20260928 13:06:33.108403 19711 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:41275 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:41275: Client connection negotiation failed: client connection to 127.3.6.62:41275: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 13:06:33.108760 19714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.108651 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:47681)
0928 13:06:33.108702 (+    51us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.108742 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:06:33.109126 19714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.109031 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:46131)
0928 13:06:33.109077 (+    46us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.109101 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 13:06:33.109226 19711 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 13:06:33.130455 19715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:33.130684 19715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:33.130721 19715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:33.131918 19715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:33.131983 19715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:33.132028 19715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:33.133474 19715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:42245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=33873
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:33.133731 19715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:33.133942 19715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:33.138726 19720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:33.138724 19721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:33.138799 19723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:33.138988 19715 server_base.cc:1034] running on GCE node
I20260928 13:06:33.139326 19715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:33.139582 19715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:33.140750 19715 hybrid_clock.cc:648] HybridClock initialized: now 1790600793140742 us; error 36 us; skew 500 ppm
Sep 28 13:06:33 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600793, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:33.143095 19715 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:06:33.143564 19715 webserver.cc:460] Webserver started at http://127.3.6.2:33873/ using document root <none> and password file <none>
I20260928 13:06:33.143785 19715 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:33.143848 19715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:33.145126 19715 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:33.145802 19730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:33.145967 19715 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:33.146059 19715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "64556ad65b8a48c29469e2ad55820193"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "73359d82bda88cd676e6fc5506f15920"
server_key_iv: "5fd69b132e1123f6f89aa9b0f3ebcf76"
server_key_version: "encryptionkey@0"
I20260928 13:06:33.146406 19715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:33.154610 19715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:33.156474 19715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:33.156630 19715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:33.156857 19715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:33.157265 19737 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 13:06:33.158772 19715 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 13:06:33.158819 19715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260928 13:06:33.158844 19715 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 13:06:33.159549 19715 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 13:06:33.159582 19715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:06:33.159668 19737 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Bootstrap starting.
I20260928 13:06:33.166738 19715 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:42245
I20260928 13:06:33.166834 19844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:42245 every 8 connection(s)
I20260928 13:06:33.167204 19715 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:33.167562  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19715
I20260928 13:06:33.167845  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:40369
--local_ip_for_outbound_sockets=127.3.6.3
--tserver_master_addrs=127.3.6.62:41275
--webserver_port=41227
--webserver_interface=127.3.6.3
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:06:33.169076 19737 log.cc:824] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:33.169756 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.169222 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:49461)
0928 13:06:33.169476 (+   254us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.169575 (+    99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":97,"threads_started":1}
W20260928 13:06:33.169988 19845 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:41275 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:41275: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
I20260928 13:06:33.170281 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.170181 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:32977)
0928 13:06:33.170228 (+    47us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.170254 (+    26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 13:06:33.170620 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.170533 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:57445)
0928 13:06:33.170577 (+    44us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.170600 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260928 13:06:33.170771 19845 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 13:06:33.172161 19737 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:33.172478 19737 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Bootstrap complete.
I20260928 13:06:33.173816 19737 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.006s
I20260928 13:06:33.176061 19737 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:33.176483 19737 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64556ad65b8a48c29469e2ad55820193, State: Initialized, Role: FOLLOWER
I20260928 13:06:33.176643 19737 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:33.176956 19737 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193: Time spent starting tablet: real 0.003s	user 0.006s	sys 0.000s
I20260928 13:06:33.177138 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.177054 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:34133)
0928 13:06:33.177084 (+    30us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.177109 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260928 13:06:33.177388 19849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.177321 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:42677)
0928 13:06:33.177348 (+    27us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.177368 (+    20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260928 13:06:33.248198 19847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:33.248420 19847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:33.248461 19847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:33.249645 19847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:33.249707 19847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:33.249753 19847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:33.251235 19847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:40369
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=41227
--tserver_master_addrs=127.3.6.62:41275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:33.251505 19847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:33.251720 19847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:33.256625 19858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:33.256732 19855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:33.256649 19856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:33.256803 19847 server_base.cc:1034] running on GCE node
I20260928 13:06:33.257120 19847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:33.257382 19847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:33.258535 19847 hybrid_clock.cc:648] HybridClock initialized: now 1790600793258507 us; error 45 us; skew 500 ppm
Sep 28 13:06:33 dist-test-slave-ddvw krb5kdc[18404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600793, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:33.260941 19847 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:06:33.261336 19847 webserver.cc:460] Webserver started at http://127.3.6.3:41227/ using document root <none> and password file <none>
I20260928 13:06:33.261567 19847 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:33.261615 19847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:33.262928 19847 fs_manager.cc:709] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:33.263521 19865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:33.263684 19847 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:33.263779 19847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "143a04b1ba19495686b805d9f2ecc9b4"
format_stamp: "Formatted at 2026-09-28 13:05:51 on dist-test-slave-ddvw"
server_key: "abc8f221cba1b59472e85d17176e24a9"
server_key_iv: "e4153edbd3f23d9f1b77eff071551caa"
server_key_version: "encryptionkey@0"
I20260928 13:06:33.264137 19847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:33.295523 19847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:33.297686 19847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:33.297863 19847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:33.298128 19847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:33.298451 19847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:33.298509 19847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:33.298545 19847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:33.298568 19847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:33.304288 19847 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:40369
I20260928 13:06:33.304333 19978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:40369 every 8 connection(s)
I20260928 13:06:33.304725 19847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:33.305781 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.305397 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:52273)
0928 13:06:33.305567 (+   170us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.305640 (+    73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
W20260928 13:06:33.306237 19979 heartbeater.cc:644] Failed to heartbeat to 127.3.6.62:41275 (0 consecutive failures): Network error: Failed to ping master at 127.3.6.62:41275: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
I20260928 13:06:33.306509 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.306424 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:42985)
0928 13:06:33.306464 (+    40us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.306491 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260928 13:06:33.306798 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:33.306727 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:46573)
0928 13:06:33.306764 (+    37us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:33.306785 (+    21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260928 13:06:33.306946 19979 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 13:06:33.313501  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 19847
I20260928 13:06:34.109875 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.109620 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:60107)
0928 13:06:34.109775 (+   155us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.109815 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":61,"threads_started":1}
I20260928 13:06:34.178020 19984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.177779 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:44893)
0928 13:06:34.177914 (+   135us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.177963 (+    49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":60,"threads_started":1}
I20260928 13:06:34.307389 19985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.307202 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:54727)
0928 13:06:34.307317 (+   115us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.307349 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260928 13:06:34.453441 19986 raft_consensus.cc:482] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:34.453600 19986 raft_consensus.cc:504] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:34.453979 19986 leader_election.cc:288] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245), 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
Sep 28 13:06:34 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600792, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.2@KRBTEST.COM
Sep 28 13:06:34 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600792, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.3@KRBTEST.COM
I20260928 13:06:34.466049 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.454122 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:40369 (local address 127.3.6.1:37347)
0928 13:06:34.454292 (+   170us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.454303 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:34.454360 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:34.455198 (+   838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:34.455199 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:34.455759 (+   560us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:34.455811 (+    52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:34.455813 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.457285 (+  1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.457286 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:34.458360 (+  1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:34.458364 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.459175 (+   811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.459190 (+    15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:34.459340 (+   150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:34.459948 (+   608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:34.459959 (+    11us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:34.462160 (+  2201us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:34.464401 (+  2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464402 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:34.464402 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:34.464675 (+   273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:34.464960 (+   285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464961 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:34.464961 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:34.465096 (+   135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:34.465577 (+   481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:34.465577 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:34.465657 (+    80us) client_negotiation.cc:769] Sending connection context
0928 13:06:34.465756 (+    99us) client_negotiation.cc:240] Negotiation successful
0928 13:06:34.465919 (+   163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":15,"thread_start_us":62,"threads_started":1}
I20260928 13:06:34.466050 19989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.454268 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:37347 (local address 127.3.6.3:40369)
0928 13:06:34.454415 (+   147us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:34.454421 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:34.454448 (+    27us) server_negotiation.cc:407] Connection header received
0928 13:06:34.454998 (+   550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:34.455000 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:34.455092 (+    92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:34.455195 (+   103us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:34.455921 (+   726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.457210 (+  1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.458459 (+  1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.459099 (+   640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.459212 (+   113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:34.462258 (+  3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:34.462261 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:34.462262 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:34.462276 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:34.464315 (+  2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464762 (+   447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:34.464764 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:34.464764 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:34.464884 (+   120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:34.465192 (+   308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:34.465193 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:34.465193 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:34.465474 (+   281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:34.465534 (+    60us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:34.465821 (+   287us) server_negotiation.cc:299] Negotiation successful
0928 13:06:34.465943 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":55,"threads_started":1}
I20260928 13:06:34.466610 19987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.454104 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:42245 (local address 127.3.6.1:51805)
0928 13:06:34.454287 (+   183us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.454299 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:34.454360 (+    61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:34.454805 (+   445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:34.454807 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:34.455144 (+   337us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:34.455494 (+   350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:34.455503 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.457128 (+  1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.457129 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:34.458361 (+  1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:34.458364 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.459176 (+   812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.459192 (+    16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:34.459340 (+   148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:34.459952 (+   612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:34.459959 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:34.461780 (+  1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:34.464126 (+  2346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464134 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:34.464136 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:34.464498 (+   362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:34.464846 (+   348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464847 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:34.464847 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:34.464990 (+   143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:34.465471 (+   481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:34.465478 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:34.465669 (+   191us) client_negotiation.cc:769] Sending connection context
0928 13:06:34.465885 (+   216us) client_negotiation.cc:240] Negotiation successful
0928 13:06:34.466240 (+   355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":9}
I20260928 13:06:34.466775 19988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.454225 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51805 (local address 127.3.6.2:42245)
0928 13:06:34.454385 (+   160us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:34.454397 (+    12us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:34.454422 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:06:34.454562 (+   140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:34.454564 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:34.454612 (+    48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:34.454743 (+   131us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:34.455621 (+   878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.457041 (+  1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.458465 (+  1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:34.459099 (+   634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:34.459212 (+   113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:34.461884 (+  2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:34.461889 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:34.461890 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:34.461903 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:34.464026 (+  2123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:34.464616 (+   590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:34.464620 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:34.464620 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:34.464770 (+   150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:34.465063 (+   293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:34.465064 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:34.465064 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:34.465379 (+   315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:34.465491 (+   112us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:34.466006 (+   515us) server_negotiation.cc:299] Negotiation successful
0928 13:06:34.466505 (+   499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":53,"threads_started":1}
I20260928 13:06:34.467389 19799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193" is_pre_election: true
I20260928 13:06:34.467556 19799 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 1.
W20260928 13:06:34.467768 19599 leader_election.cc:341] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369): Not found: Tablet not found: 4d423fd131c94bb0a7b157cb5decba1d
I20260928 13:06:34.467855 19599 leader_election.cc:302] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f8731c5f5134712b77f001cb3abf328, 64556ad65b8a48c29469e2ad55820193; no voters: 143a04b1ba19495686b805d9f2ecc9b4
I20260928 13:06:34.467960 19986 raft_consensus.cc:2781] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 13:06:34.468027 19986 raft_consensus.cc:482] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:34.468070 19986 raft_consensus.cc:3037] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 1 FOLLOWER]: Advancing to term 2
I20260928 13:06:34.469799 19986 raft_consensus.cc:504] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:34.469959 19986 leader_election.cc:288] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 election: Requested vote from peers 64556ad65b8a48c29469e2ad55820193 (127.3.6.2:42245), 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369)
I20260928 13:06:34.470134 19799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d423fd131c94bb0a7b157cb5decba1d" candidate_uuid: "5f8731c5f5134712b77f001cb3abf328" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "64556ad65b8a48c29469e2ad55820193"
I20260928 13:06:34.470217 19799 raft_consensus.cc:3037] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 1 FOLLOWER]: Advancing to term 2
W20260928 13:06:34.470293 19599 leader_election.cc:341] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369): Not found: Tablet not found: 4d423fd131c94bb0a7b157cb5decba1d
I20260928 13:06:34.471741 19799 raft_consensus.cc:2454] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f8731c5f5134712b77f001cb3abf328 in term 2.
I20260928 13:06:34.472460 19598 leader_election.cc:302] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5f8731c5f5134712b77f001cb3abf328, 64556ad65b8a48c29469e2ad55820193; no voters: 143a04b1ba19495686b805d9f2ecc9b4
I20260928 13:06:34.472625 19986 raft_consensus.cc:2781] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 2 FOLLOWER]: Leader election won for term 2
I20260928 13:06:34.472756 19986 raft_consensus.cc:686] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [term 2 LEADER]: Becoming Leader. State: Replica: 5f8731c5f5134712b77f001cb3abf328, State: Running, Role: LEADER
I20260928 13:06:34.472853 19986 consensus_queue.cc:237] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:34.473161 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.472978 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:48253)
0928 13:06:34.473095 (+   117us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.473126 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260928 13:06:34.933279 19599 consensus_peers.cc:487] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 -> Peer 143a04b1ba19495686b805d9f2ecc9b4 (127.3.6.3:40369): Couldn't send request to peer 143a04b1ba19495686b805d9f2ecc9b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d423fd131c94bb0a7b157cb5decba1d. This is attempt 1: this message will repeat every 5th retry.
I20260928 13:06:34.956065 19799 raft_consensus.cc:1261] T 4d423fd131c94bb0a7b157cb5decba1d P 64556ad65b8a48c29469e2ad55820193 [term 2 FOLLOWER]: Refusing update from remote peer 5f8731c5f5134712b77f001cb3abf328: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260928 13:06:34.956458 19986 consensus_queue.cc:1035] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260928 13:06:34.957357 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.957191 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:38175)
0928 13:06:34.957288 (+    97us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.957322 (+    34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":57,"threads_started":1}
I20260928 13:06:34.958477 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.958319 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:47373)
0928 13:06:34.958387 (+    68us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.958417 (+    30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260928 13:06:34.958503 19983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:34.958339 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:50835)
0928 13:06:34.958430 (+    91us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:34.958469 (+    39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260928 13:06:35.307967 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.307760 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:34123)
0928 13:06:35.307871 (+   111us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.307923 (+    52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":56,"threads_started":1}
I20260928 13:06:35.414491 19998 ts_tablet_manager.cc:927] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Initiating tablet copy from peer 5f8731c5f5134712b77f001cb3abf328 (127.3.6.1:36447)
I20260928 13:06:35.414737 19998 tablet_copy_client.cc:316] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: tablet copy: Beginning tablet copy session from remote peer at address 127.3.6.1:36447
Sep 28 13:06:35 dist-test-slave-ddvw krb5kdc[18404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600793, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.1@KRBTEST.COM
I20260928 13:06:35.422470 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.415119 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:48059 (local address 127.3.6.1:36447)
0928 13:06:35.415250 (+   131us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:35.415256 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:35.415268 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:06:35.415296 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:35.415298 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:35.415318 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:35.415386 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:35.415825 (+   439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:35.416511 (+   686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:35.417241 (+   730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:35.417556 (+   315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:35.417611 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:35.419797 (+  2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:35.419806 (+     9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:35.419806 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:35.419813 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:35.421344 (+  1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:35.421716 (+   372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:35.421719 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:35.421719 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:35.421774 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:35.421953 (+   179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:35.421953 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:35.421954 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:35.422108 (+   154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:35.422172 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:35.422319 (+   147us) server_negotiation.cc:299] Negotiation successful
0928 13:06:35.422385 (+    66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":82,"threads_started":1}
I20260928 13:06:35.422482 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.414997 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:36447 (local address 127.3.6.3:48059)
0928 13:06:35.415078 (+    81us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.415097 (+    19us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:35.415160 (+    63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:35.415397 (+   237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:35.415401 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:35.415685 (+   284us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:35.415756 (+    71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:35.415758 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:35.416584 (+   826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:35.416585 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:35.417170 (+   585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:35.417172 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:35.417619 (+   447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:35.417622 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:35.417677 (+    55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:35.418242 (+   565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:35.418246 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:35.419699 (+  1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:35.421423 (+  1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:35.421430 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:35.421432 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:35.421643 (+   211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:35.421831 (+   188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:35.421832 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:35.421832 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:35.421888 (+    56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:35.422161 (+   273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:35.422167 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:35.422217 (+    50us) client_negotiation.cc:769] Sending connection context
0928 13:06:35.422282 (+    65us) client_negotiation.cc:240] Negotiation successful
0928 13:06:35.422377 (+    95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260928 13:06:35.423091 19685 tablet_copy_service.cc:140] P 5f8731c5f5134712b77f001cb3abf328: Received BeginTabletCopySession request for tablet 4d423fd131c94bb0a7b157cb5decba1d from peer 143a04b1ba19495686b805d9f2ecc9b4 ({username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:48059)
I20260928 13:06:35.423156 19685 tablet_copy_service.cc:161] P 5f8731c5f5134712b77f001cb3abf328: Beginning new tablet copy session on tablet 4d423fd131c94bb0a7b157cb5decba1d from peer 143a04b1ba19495686b805d9f2ecc9b4 at {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:48059: session id = 143a04b1ba19495686b805d9f2ecc9b4-4d423fd131c94bb0a7b157cb5decba1d
I20260928 13:06:35.423712 19685 tablet_copy_source_session.cc:205] T 4d423fd131c94bb0a7b157cb5decba1d P 5f8731c5f5134712b77f001cb3abf328: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 13:06:35.424685 19998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d423fd131c94bb0a7b157cb5decba1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:35.427402 19998 tablet_copy_client.cc:791] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: tablet copy: Starting download of 0 data blocks...
I20260928 13:06:35.427582 19998 tablet_copy_client.cc:655] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: tablet copy: Starting download of 1 WAL segments...
I20260928 13:06:35.428372 19998 tablet_copy_client.cc:531] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 13:06:35.429067 19998 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Bootstrap starting.
I20260928 13:06:35.430414 19998 log.cc:824] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:35.433066 19998 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 13:06:35.433332 19998 tablet_bootstrap.cc:492] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Bootstrap complete.
I20260928 13:06:35.433477 19998 ts_tablet_manager.cc:1397] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Time spent bootstrapping tablet: real 0.004s	user 0.000s	sys 0.002s
I20260928 13:06:35.434417 19998 raft_consensus.cc:348] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:35.434582 19998 raft_consensus.cc:729] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 143a04b1ba19495686b805d9f2ecc9b4, State: Initialized, Role: FOLLOWER
I20260928 13:06:35.434731 19998 consensus_queue.cc:260] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64556ad65b8a48c29469e2ad55820193" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 42245 } } peers { permanent_uuid: "143a04b1ba19495686b805d9f2ecc9b4" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 40369 } } peers { permanent_uuid: "5f8731c5f5134712b77f001cb3abf328" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 36447 } }
I20260928 13:06:35.434998 19998 ts_tablet_manager.cc:1428] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4: Time spent starting tablet: real 0.001s	user 0.004s	sys 0.000s
I20260928 13:06:35.435316 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.435211 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:60649)
0928 13:06:35.435262 (+    51us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.435289 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 13:06:35.435312 19685 tablet_copy_service.cc:342] P 5f8731c5f5134712b77f001cb3abf328: Request end of tablet copy session 143a04b1ba19495686b805d9f2ecc9b4-4d423fd131c94bb0a7b157cb5decba1d received from {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:48059
I20260928 13:06:35.435372 19685 tablet_copy_service.cc:433] P 5f8731c5f5134712b77f001cb3abf328: ending tablet copy session 143a04b1ba19495686b805d9f2ecc9b4-4d423fd131c94bb0a7b157cb5decba1d on tablet 4d423fd131c94bb0a7b157cb5decba1d with peer 143a04b1ba19495686b805d9f2ecc9b4
I20260928 13:06:35.435652 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.435550 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:51925)
0928 13:06:35.435597 (+    47us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.435625 (+    28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:06:35.932948 20004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.932737 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:47203)
0928 13:06:35.932859 (+   122us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.932896 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":48,"threads_started":1}
I20260928 13:06:35.932852 19933 raft_consensus.cc:1203] T 4d423fd131c94bb0a7b157cb5decba1d P 143a04b1ba19495686b805d9f2ecc9b4 [term 2 FOLLOWER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3]   Dedup: 2.3->[]
I20260928 13:06:35.933362 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.933235 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:55517)
0928 13:06:35.933292 (+    57us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.933330 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 13:06:35.959103 20005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:35.958870 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:59957)
0928 13:06:35.959003 (+   133us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:35.959047 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":59,"threads_started":1}
I20260928 13:06:36.933682 20006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:36.933429 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:48155)
0928 13:06:36.933588 (+   159us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:36.933634 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":75,"threads_started":1}
I20260928 13:06:36.933979 20007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:36.933755 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:45571)
0928 13:06:36.933889 (+   134us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:36.933924 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260928 13:06:36.959692 20008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:36.959492 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:60267)
0928 13:06:36.959610 (+   118us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:36.959647 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260928 13:06:37.934403 20009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:37.934169 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:59065)
0928 13:06:37.934316 (+   147us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:37.934354 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
I20260928 13:06:37.934698 20010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:37.934381 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:55167)
0928 13:06:37.934624 (+   243us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:37.934665 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":163,"threads_started":1}
I20260928 13:06:37.960410 20011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:37.960177 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:44589)
0928 13:06:37.960330 (+   153us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:37.960362 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260928 13:06:38.935187 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:38.934965 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:45951)
0928 13:06:38.935105 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:38.935142 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":100,"threads_started":1}
I20260928 13:06:38.935516 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:38.935423 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:59445)
0928 13:06:38.935468 (+    45us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:38.935494 (+    26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:06:38.935602 20014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:38.935230 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:47363)
0928 13:06:38.935498 (+   268us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:38.935559 (+    61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":75,"threads_started":1}
I20260928 13:06:38.961198 20015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:38.960952 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:42019)
0928 13:06:38.961109 (+   157us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:38.961152 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260928 13:06:39.936198 20016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:39.935981 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:54679)
0928 13:06:39.936117 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:39.936152 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260928 13:06:39.936210 20017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:39.936017 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:49457)
0928 13:06:39.936132 (+   115us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:39.936170 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":73,"threads_started":1}
I20260928 13:06:39.961886 20018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:39.961658 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:50099)
0928 13:06:39.961799 (+   141us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:39.961840 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":62,"threads_started":1}
I20260928 13:06:40.936928 20019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:40.936689 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:57803)
0928 13:06:40.936839 (+   150us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:40.936881 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":58,"threads_started":1}
I20260928 13:06:40.936933 20020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:40.936703 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:48373)
0928 13:06:40.936850 (+   147us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:40.936883 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260928 13:06:40.962600 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:40.962358 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:49131)
0928 13:06:40.962510 (+   152us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:40.962551 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":63,"threads_started":1}
I20260928 13:06:41.937700 20023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:41.937477 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:59493)
0928 13:06:41.937625 (+   148us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:41.937658 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260928 13:06:41.937696 20022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:41.937477 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:56971)
0928 13:06:41.937619 (+   142us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:41.937650 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
I20260928 13:06:41.963474 20024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:41.963216 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:50807)
0928 13:06:41.963378 (+   162us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:41.963424 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260928 13:06:42.938405 20026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:42.938180 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:33435)
0928 13:06:42.938330 (+   150us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:42.938363 (+    33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
I20260928 13:06:42.938390 20025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:42.938156 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:51927)
0928 13:06:42.938296 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:42.938340 (+    44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":62,"threads_started":1}
I20260928 13:06:42.964264 20027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:42.964020 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:36363)
0928 13:06:42.964173 (+   153us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:42.964220 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260928 13:06:43.939141 20029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:43.938909 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:39091)
0928 13:06:43.939062 (+   153us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:43.939096 (+    34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":58,"threads_started":1}
I20260928 13:06:43.939174 20030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:43.938920 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:58871)
0928 13:06:43.939091 (+   171us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:43.939126 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":79,"threads_started":1}
I20260928 13:06:43.965003 20031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:43.964770 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:41997)
0928 13:06:43.964908 (+   138us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:43.964950 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
I20260928 13:06:44.939867 20034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:44.939621 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:35947)
0928 13:06:44.939781 (+   160us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:44.939824 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260928 13:06:44.939867 20033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:44.939621 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:54953)
0928 13:06:44.939788 (+   167us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:44.939819 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":78,"threads_started":1}
I20260928 13:06:44.965795 20035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:44.965543 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:53029)
0928 13:06:44.965701 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:44.965746 (+    45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260928 13:06:45.940598 20037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:45.940388 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:58915)
0928 13:06:45.940530 (+   142us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:45.940557 (+    27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":78,"threads_started":1}
I20260928 13:06:45.940595 20038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:45.940386 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:39525)
0928 13:06:45.940511 (+   125us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:45.940548 (+    37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":78,"threads_started":1}
I20260928 13:06:45.966657 20039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:45.966342 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:52983)
0928 13:06:45.966552 (+   210us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:45.966607 (+    55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":116,"threads_started":1}
I20260928 13:06:46.941341 20042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:46.941097 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:52365)
0928 13:06:46.941252 (+   155us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:46.941294 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":78,"threads_started":1}
I20260928 13:06:46.941341 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:46.941097 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:36279)
0928 13:06:46.941265 (+   168us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:46.941296 (+    31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
I20260928 13:06:46.967491 20043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:46.967268 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:38933)
0928 13:06:46.967393 (+   125us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:46.967440 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":65,"threads_started":1}
I20260928 13:06:47.942139 20044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:47.941896 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.1:46541)
0928 13:06:47.942039 (+   143us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:47.942081 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260928 13:06:47.942142 20045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:47.941897 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.3:53417)
0928 13:06:47.942073 (+   176us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:47.942105 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":92,"threads_started":1}
I20260928 13:06:47.968278 20046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:47.968014 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:41275 (local address 127.3.6.2:48909)
0928 13:06:47.968182 (+   168us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:47.968228 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.62:41275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":74,"threads_started":1}
I20260928 13:06:48.318207  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19546
I20260928 13:06:48.323386  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19715
I20260928 13:06:48.327893  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 19847
2026-09-28T13:06:48Z chronyd exiting
[       OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58591 ms)
[----------] 30 tests from SecurityITest (231906 ms total)

[----------] 6 tests from EncryptionPolicyTest
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:48 dist-test-slave-ddvw krb5kdc[20049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:48 dist-test-slave-ddvw krb5kdc[20049](info): set up 2 sockets
Sep 28 13:06:48 dist-test-slave-ddvw krb5kdc[20049](info): commencing operation
krb5kdc: starting...
W20260928 13:06:49.370874  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.022s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:06:49.487983  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35677
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:35677
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:49.569983 20062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:49.570253 20062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:49.570291 20062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:49.571530 20062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:49.571619 20062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:49.571648 20062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:49.571679 20062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:49.571720 20062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:49.573237 20062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:35677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:35677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:49.573525 20062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:49.573771 20062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:49.579190 20068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:49.579203 20070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:49.579253 20062 server_base.cc:1034] running on GCE node
W20260928 13:06:49.579205 20067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:49.579669 20062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:49.580070 20062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:49.581218 20062 hybrid_clock.cc:648] HybridClock initialized: now 1790600809581196 us; error 41 us; skew 500 ppm
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:49.583956 20062 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:06:49.584391 20062 webserver.cc:460] Webserver started at http://127.3.6.62:36663/ using document root <none> and password file <none>
I20260928 13:06:49.584635 20062 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:49.584681 20062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:49.584828 20062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:49.585906 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "c3a7a56861da407ab3107b050056d9ca"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "979ab0c1a5b6353f230fa35d6af7e9af"
server_key_iv: "634f8376023798d04b40cea84655679f"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.586310 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "c3a7a56861da407ab3107b050056d9ca"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "979ab0c1a5b6353f230fa35d6af7e9af"
server_key_iv: "634f8376023798d04b40cea84655679f"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.587720 20062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:06:49.588460 20077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.588667 20062 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:49.588759 20062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "c3a7a56861da407ab3107b050056d9ca"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "979ab0c1a5b6353f230fa35d6af7e9af"
server_key_iv: "634f8376023798d04b40cea84655679f"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.588831 20062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:49.604684 20062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:49.606685 20062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:49.606833 20062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:49.611219 20062 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:35677
I20260928 13:06:49.611267 20129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:35677 every 8 connection(s)
I20260928 13:06:49.611624 20062 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:49.612470 20130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:49.612756  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20062
I20260928 13:06:49.612867  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:49.613078  3096 external_mini_cluster.cc:1428] Setting key bdb09aeb8f9c1f150925897740ddc385
I20260928 13:06:49.616209 20130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: Bootstrap starting.
I20260928 13:06:49.616932 20130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:49.617228 20130 log.cc:824] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:49.617990 20130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: No bootstrap required, opened a new log
I20260928 13:06:49.620113 20130 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } }
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:49.620313 20130 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:49.620352 20130 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3a7a56861da407ab3107b050056d9ca, State: Initialized, Role: FOLLOWER
I20260928 13:06:49.620500 20130 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } }
I20260928 13:06:49.620594 20130 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:49.620639 20130 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:49.620689 20130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:49.621297 20130 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } }
I20260928 13:06:49.621426 20130 leader_election.cc:302] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3a7a56861da407ab3107b050056d9ca; no voters: 
I20260928 13:06:49.621598 20130 leader_election.cc:288] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:49.621645 20135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:49.621824 20135 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [term 1 LEADER]: Becoming Leader. State: Replica: c3a7a56861da407ab3107b050056d9ca, State: Running, Role: LEADER
I20260928 13:06:49.621886 20130 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:49.622222 20135 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } }
I20260928 13:06:49.622597 20136 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3a7a56861da407ab3107b050056d9ca. Latest consensus state: current_term: 1 leader_uuid: "c3a7a56861da407ab3107b050056d9ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } } }
I20260928 13:06:49.622675 20136 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:49.622900 20137 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3a7a56861da407ab3107b050056d9ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3a7a56861da407ab3107b050056d9ca" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 35677 } } }
I20260928 13:06:49.623045 20137 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:49.623245 20143 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:49.623792 20143 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:49.624917 20133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:49.613671 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46702 (local address 127.3.6.62:35677)
0928 13:06:49.613879 (+   208us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:49.613889 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:49.613924 (+    35us) server_negotiation.cc:407] Connection header received
0928 13:06:49.614397 (+   473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:49.614407 (+    10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:49.614473 (+    66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:49.614625 (+   152us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:49.615328 (+   703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.616710 (+  1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.617601 (+   891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.618083 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.618213 (+   130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:49.620916 (+  2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:49.620921 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:49.620922 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:49.620932 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:49.623164 (+  2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.623647 (+   483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.623651 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.623651 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.623787 (+   136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.624023 (+   236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.624024 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.624024 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.624334 (+   310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:49.624518 (+   184us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:49.624598 (+    80us) server_negotiation.cc:299] Negotiation successful
0928 13:06:49.624737 (+   139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":80,"threads_started":1}
I20260928 13:06:49.627410 20143 catalog_manager.cc:1347] Generated new cluster ID: a9ac33e684ae4c679776fed63cd1968d
I20260928 13:06:49.627461 20143 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:49.631142 20143 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:49.631651 20143 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:49.633881 20143 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: Generated new TSK 0
I20260928 13:06:49.634054 20143 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:06:49.660041  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:49.741715 20156 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:49.741925 20156 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:49.741950 20156 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:49.743202 20156 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:49.743244 20156 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:49.743271 20156 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:49.744802 20156 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20156
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:49.745039 20156 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:49.745297 20156 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:49.750985 20162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:49.750991 20161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:49.750991 20164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:49.751058 20156 server_base.cc:1034] running on GCE node
I20260928 13:06:49.751374 20156 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:49.751621 20156 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:49.752785 20156 hybrid_clock.cc:648] HybridClock initialized: now 1790600809752773 us; error 29 us; skew 500 ppm
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:49.755311 20156 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:06:49.755843 20156 webserver.cc:460] Webserver started at http://127.3.6.1:41589/ using document root <none> and password file <none>
I20260928 13:06:49.756072 20156 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:49.756116 20156 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:49.756285 20156 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:49.757799 20156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "16c0ff26006d4d249f9443568c0466e3"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "03ad8a5065f02faaf389e22cb3e0d0dc"
server_key_iv: "4720bd5b2162607be101144a42c30616"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.758200 20156 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "16c0ff26006d4d249f9443568c0466e3"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "03ad8a5065f02faaf389e22cb3e0d0dc"
server_key_iv: "4720bd5b2162607be101144a42c30616"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.759924 20156 fs_manager.cc:691] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.004s
I20260928 13:06:49.760588 20171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.760763 20156 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:49.760850 20156 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "16c0ff26006d4d249f9443568c0466e3"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "03ad8a5065f02faaf389e22cb3e0d0dc"
server_key_iv: "4720bd5b2162607be101144a42c30616"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.760910 20156 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:49.770447 20156 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:49.772267 20156 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:49.772377 20156 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:49.772580 20156 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:49.772899 20156 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:49.772933 20156 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.772953 20156 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:49.773003 20156 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.778519 20156 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:46341
I20260928 13:06:49.778599 20284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:46341 every 8 connection(s)
I20260928 13:06:49.778923 20156 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:49.784873  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20156
I20260928 13:06:49.785000  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:49.785250  3096 external_mini_cluster.cc:1428] Setting key 2987a07a4fda0580d9a3c80699cafaf6
I20260928 13:06:49.788815 20133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:49.779711 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:51333 (local address 127.3.6.62:35677)
0928 13:06:49.779780 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:49.779782 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:49.780014 (+   232us) server_negotiation.cc:407] Connection header received
0928 13:06:49.780496 (+   482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:49.780497 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:49.780508 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:49.780562 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:49.781518 (+   956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.782026 (+   508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.783052 (+  1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.783264 (+   212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.783319 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:49.785742 (+  2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:49.785743 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:49.785744 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:49.785750 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:49.787423 (+  1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.787840 (+   417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.787841 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.787841 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.787908 (+    67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.788140 (+   232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.788141 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.788141 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.788265 (+   124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:49.788320 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:49.788576 (+   256us) server_negotiation.cc:299] Negotiation successful
0928 13:06:49.788674 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:06:49.788843 20287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:49.779693 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35677 (local address 127.3.6.1:51333)
0928 13:06:49.779882 (+   189us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:49.779921 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:49.780406 (+   485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:49.780645 (+   239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:49.780648 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:49.781233 (+   585us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:49.781431 (+   198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:49.781436 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.782107 (+   671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.782108 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:49.782927 (+   819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:49.782929 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.783328 (+   399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.783340 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:49.783442 (+   102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:49.783950 (+   508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:49.783959 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:49.785643 (+  1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:49.787509 (+  1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:49.787516 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:49.787518 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:49.787762 (+   244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:49.787976 (+   214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:49.787976 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:49.787976 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:49.788075 (+    99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:49.788323 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:49.788327 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:49.788442 (+   115us) client_negotiation.cc:769] Sending connection context
0928 13:06:49.788526 (+    84us) client_negotiation.cc:240] Negotiation successful
0928 13:06:49.788658 (+   132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":103,"threads_started":1}
I20260928 13:06:49.789609 20285 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35677
I20260928 13:06:49.789716 20285 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:49.789928 20285 heartbeater.cc:511] Master 127.3.6.62:35677 requested a full tablet report, sending...
I20260928 13:06:49.790501 20094 ts_manager.cc:194] Registered new tserver with Master: 16c0ff26006d4d249f9443568c0466e3 (127.3.6.1:46341)
I20260928 13:06:49.791231 20094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:51333
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:06:49.810802  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:49.891453 20290 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:49.891696 20290 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:49.891732 20290 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:49.892863 20290 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:49.892933 20290 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:49.892979 20290 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:49.894389 20290 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20290
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:49.894656 20290 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:49.894883 20290 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:49.899771 20295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:49.899811 20290 server_base.cc:1034] running on GCE node
W20260928 13:06:49.899782 20296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:49.899806 20298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:49.900480 20290 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:49.900791 20290 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:49.901942 20290 hybrid_clock.cc:648] HybridClock initialized: now 1790600809901932 us; error 27 us; skew 500 ppm
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:49.904354 20290 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:06:49.904731 20290 webserver.cc:460] Webserver started at http://127.3.6.2:46459/ using document root <none> and password file <none>
I20260928 13:06:49.904946 20290 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:49.905001 20290 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:49.905092 20290 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:49.906075 20290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "1ba96fd996f2492fa46c0e0264f7f58f"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "47e1610d116e0b95fa87d19472b6ab18"
server_key_iv: "3c1c6270404fa5157c9084647106d972"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.906379 20290 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "1ba96fd996f2492fa46c0e0264f7f58f"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "47e1610d116e0b95fa87d19472b6ab18"
server_key_iv: "3c1c6270404fa5157c9084647106d972"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.907737 20290 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:49.908387 20305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.908596 20290 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:06:49.908686 20290 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "1ba96fd996f2492fa46c0e0264f7f58f"
format_stamp: "Formatted at 2026-09-28 13:06:49 on dist-test-slave-ddvw"
server_key: "47e1610d116e0b95fa87d19472b6ab18"
server_key_iv: "3c1c6270404fa5157c9084647106d972"
server_key_version: "encryptionkey@0"
I20260928 13:06:49.908742 20290 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:49.928149 20290 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:49.930608 20290 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:49.930734 20290 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:49.930943 20290 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:49.931306 20290 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:49.931345 20290 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.931392 20290 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:49.931419 20290 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:49.937207 20290 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:41725
I20260928 13:06:49.937357 20418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:41725 every 8 connection(s)
I20260928 13:06:49.937633 20290 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:06:49 dist-test-slave-ddvw krb5kdc[20049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600809, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:49.945688  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20290
I20260928 13:06:49.945835  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:49.946056  3096 external_mini_cluster.cc:1428] Setting key 6dcb4b273b4421bfd0adfbbe589c8132
I20260928 13:06:49.948122 20133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:49.938487 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:35451 (local address 127.3.6.62:35677)
0928 13:06:49.938618 (+   131us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:49.938620 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:49.938797 (+   177us) server_negotiation.cc:407] Connection header received
0928 13:06:49.939472 (+   675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:49.939473 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:49.939486 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:49.939540 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:49.940574 (+  1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.941091 (+   517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.942149 (+  1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.942368 (+   219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.942465 (+    97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:49.944802 (+  2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:49.944804 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:49.944804 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:49.944812 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:49.946563 (+  1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.947107 (+   544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.947109 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.947109 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.947174 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:49.947442 (+   268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:49.947443 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:49.947443 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:49.947563 (+   120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:49.947641 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:49.947945 (+   304us) server_negotiation.cc:299] Negotiation successful
0928 13:06:49.948034 (+    89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260928 13:06:49.948355 20421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:49.938456 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35677 (local address 127.3.6.2:35451)
0928 13:06:49.938655 (+   199us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:49.938700 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:49.939347 (+   647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:49.939620 (+   273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:49.939623 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:49.940227 (+   604us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:49.940436 (+   209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:49.940441 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.941193 (+   752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.941194 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:49.942032 (+   838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:49.942035 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:49.942466 (+   431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:49.942479 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:49.942615 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:49.943207 (+   592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:49.943215 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:49.944695 (+  1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:49.946670 (+  1975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:49.946677 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:49.946680 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:49.946979 (+   299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:49.947247 (+   268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:49.947248 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:49.947249 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:49.947368 (+   119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:49.947631 (+   263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:49.947638 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:49.947786 (+   148us) client_negotiation.cc:769] Sending connection context
0928 13:06:49.947889 (+   103us) client_negotiation.cc:240] Negotiation successful
0928 13:06:49.948059 (+   170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260928 13:06:49.948952 20419 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35677
I20260928 13:06:49.949071 20419 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:49.949290 20419 heartbeater.cc:511] Master 127.3.6.62:35677 requested a full tablet report, sending...
I20260928 13:06:49.949684 20094 ts_manager.cc:194] Registered new tserver with Master: 1ba96fd996f2492fa46c0e0264f7f58f (127.3.6.2:41725)
I20260928 13:06:49.950207 20094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:35451
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:06:49.971421  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:34527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:50.052428 20424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:50.052629 20424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:50.052652 20424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:50.053812 20424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:50.053854 20424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:50.053881 20424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:50.055327 20424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:34527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:35677
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:50.055569 20424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:50.055828 20424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:50.061137 20432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.061105 20430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.061161 20424 server_base.cc:1034] running on GCE node
W20260928 13:06:50.061120 20429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.061532 20424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:50.061774 20424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:50.062940 20424 hybrid_clock.cc:648] HybridClock initialized: now 1790600810062931 us; error 36 us; skew 500 ppm
Sep 28 13:06:50 dist-test-slave-ddvw krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600810, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:50.065481 20424 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:06:50.065940 20424 webserver.cc:460] Webserver started at http://127.3.6.3:46763/ using document root <none> and password file <none>
I20260928 13:06:50.066128 20424 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:50.066170 20424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:50.066265 20424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:50.067415 20424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "a29485ae41e94129a910463023a63a2a"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "385d1accd59cd1619310b320d85c0b2b"
server_key_iv: "f840c331afd887782a4077a260aeb4cc"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.067737 20424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "a29485ae41e94129a910463023a63a2a"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "385d1accd59cd1619310b320d85c0b2b"
server_key_iv: "f840c331afd887782a4077a260aeb4cc"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.069128 20424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:50.069911 20439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.070091 20424 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:50.070178 20424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "a29485ae41e94129a910463023a63a2a"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "385d1accd59cd1619310b320d85c0b2b"
server_key_iv: "f840c331afd887782a4077a260aeb4cc"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.070237 20424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:50.082922 20424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:50.085326 20424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:50.085441 20424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:50.085635 20424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:50.085899 20424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:50.085930 20424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.085952 20424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:50.085999 20424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.091807 20424 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:37337
I20260928 13:06:50.091887 20552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:37337 every 8 connection(s)
I20260928 13:06:50.092219 20424 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:50.096279  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20424
I20260928 13:06:50.096386  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:50.096588  3096 external_mini_cluster.cc:1428] Setting key 127730e6ffb6fb4bb93a990af2762101
Sep 28 13:06:50 dist-test-slave-ddvw krb5kdc[20049](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600810, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:50.101737 20133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.092973 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:50493 (local address 127.3.6.62:35677)
0928 13:06:50.093016 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.093018 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.093203 (+   185us) server_negotiation.cc:407] Connection header received
0928 13:06:50.093750 (+   547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.093751 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.093763 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.093815 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.094766 (+   951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.095339 (+   573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.096476 (+  1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.096740 (+   264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.096815 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.098954 (+  2139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.098956 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.098956 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:50.098962 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.100546 (+  1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:50.100991 (+   445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:50.100992 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:50.100992 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:50.101047 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:50.101264 (+   217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:50.101264 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:50.101265 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:50.101358 (+    93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.101403 (+    45us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.101616 (+   213us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.101673 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:06:50.101961 20555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.092941 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:35677 (local address 127.3.6.3:50493)
0928 13:06:50.093081 (+   140us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.093120 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.093618 (+   498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.093893 (+   275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.093899 (+     6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.094453 (+   554us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:50.094650 (+   197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.094654 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.095432 (+   778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.095433 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.096365 (+   932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.096369 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.096824 (+   455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.096836 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.096987 (+   151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.097539 (+   552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:50.097548 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:50.098873 (+  1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:50.100652 (+  1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:50.100658 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:50.100660 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:50.100921 (+   261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:50.101111 (+   190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:50.101111 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:50.101111 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:50.101222 (+   111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:50.101405 (+   183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:50.101409 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:50.101518 (+   109us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.101597 (+    79us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.101712 (+   115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260928 13:06:50.102402 20553 heartbeater.cc:347] Connected to a master server at 127.3.6.62:35677
I20260928 13:06:50.102511 20553 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:50.102747 20553 heartbeater.cc:511] Master 127.3.6.62:35677 requested a full tablet report, sending...
I20260928 13:06:50.103137 20094 ts_manager.cc:194] Registered new tserver with Master: a29485ae41e94129a910463023a63a2a (127.3.6.3:37337)
I20260928 13:06:50.103508 20094 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:50493
I20260928 13:06:50.108310  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:50.115473 20133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.109631 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46710 (local address 127.3.6.62:35677)
0928 13:06:50.109712 (+    81us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.109715 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.109814 (+    99us) server_negotiation.cc:407] Connection header received
0928 13:06:50.109851 (+    37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.109851 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.109859 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.109901 (+    42us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.110426 (+   525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.110888 (+   462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.111744 (+   856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.111915 (+   171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.111972 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.113111 (+  1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.113112 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.113112 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:50.113118 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.114486 (+  1368us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:50.114796 (+   310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:50.114796 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:50.114797 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:50.114845 (+    48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:50.114981 (+   136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:50.114982 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:50.114982 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:50.115157 (+   175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.115236 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.115339 (+   103us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.115396 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260928 13:06:50.117002 20094 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46710:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:50.118541 20094 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:50.125478 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.120838 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:37337 (local address 127.0.0.1:48348)
0928 13:06:50.121579 (+   741us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.121588 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.121812 (+   224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.122088 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.122089 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.122091 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.122133 (+    42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.122135 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.123379 (+  1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.123380 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.124463 (+  1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.124465 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125152 (+   687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125153 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.125235 (+    82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125248 (+    13us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.125344 (+    96us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.125401 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"mutex_wait_us":251,"thread_start_us":56,"threads_started":1}
I20260928 13:06:50.125487 20566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.121175 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48348 (local address 127.3.6.3:37337)
0928 13:06:50.121539 (+   364us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.121543 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.121783 (+   240us) server_negotiation.cc:407] Connection header received
0928 13:06:50.121918 (+   135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.121920 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.121937 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.121990 (+    53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.122229 (+   239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.123279 (+  1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.124575 (+  1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125048 (+   473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125155 (+   107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125218 (+    63us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.125359 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.125401 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":87,"threads_started":1}
I20260928 13:06:50.125773 20563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.120948 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34990 (local address 127.3.6.2:41725)
0928 13:06:50.121135 (+   187us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.121140 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.121331 (+   191us) server_negotiation.cc:407] Connection header received
0928 13:06:50.121435 (+   104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.121438 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.121453 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.121546 (+    93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.121773 (+   227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.122853 (+  1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.124358 (+  1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125098 (+   740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125167 (+    69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125222 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.125643 (+   421us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.125698 (+    55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
I20260928 13:06:50.125914 20562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.120838 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46341 (local address 127.0.0.1:45456)
0928 13:06:50.121340 (+   502us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.121350 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.121412 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.121696 (+   284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.121697 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.121699 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.121747 (+    48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.121749 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.123048 (+  1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.123049 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.124463 (+  1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.124465 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125642 (+  1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125643 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.125708 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125712 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.125764 (+    52us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.125801 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":53,"thread_start_us":52,"threads_started":1}
I20260928 13:06:50.126034 20564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.120838 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41725 (local address 127.0.0.1:34990)
0928 13:06:50.121213 (+   375us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.121256 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.121342 (+    86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.121606 (+   264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.121609 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.121612 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.121677 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.121679 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.123053 (+  1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.123053 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.124287 (+  1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.124290 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125442 (+  1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125443 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.125502 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125505 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.125852 (+   347us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.125924 (+    72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":43,"thread_start_us":60,"threads_started":1}
I20260928 13:06:50.126228 20565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.121122 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45456 (local address 127.3.6.1:46341)
0928 13:06:50.121316 (+   194us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.121321 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.121396 (+    75us) server_negotiation.cc:407] Connection header received
0928 13:06:50.121491 (+    95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.121493 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.121509 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.121590 (+    81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.121903 (+   313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.122933 (+  1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.124564 (+  1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.125269 (+   705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.125357 (+    88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.125407 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.126089 (+   682us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.126137 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260928 13:06:50.126250 20487 tablet_service.cc:1467] Processing CreateTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 (DEFAULT_TABLE table=test-table [id=577fa4ca600f4a6d8251c170c2bfaad4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.126612 20487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c5c4ed9ae4411091e513259f6c8088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.126745 20353 tablet_service.cc:1467] Processing CreateTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 (DEFAULT_TABLE table=test-table [id=577fa4ca600f4a6d8251c170c2bfaad4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.126829 20219 tablet_service.cc:1467] Processing CreateTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 (DEFAULT_TABLE table=test-table [id=577fa4ca600f4a6d8251c170c2bfaad4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.127104 20353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c5c4ed9ae4411091e513259f6c8088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.127188 20219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c5c4ed9ae4411091e513259f6c8088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.129808 20567 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Bootstrap starting.
I20260928 13:06:50.130262 20568 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Bootstrap starting.
I20260928 13:06:50.130381 20569 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: Bootstrap starting.
I20260928 13:06:50.130669 20567 tablet_bootstrap.cc:654] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.130908 20568 tablet_bootstrap.cc:654] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.131103 20569 tablet_bootstrap.cc:654] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.131357 20567 log.cc:824] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.131526 20568 log.cc:824] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.131731 20569 log.cc:824] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.132207 20567 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: No bootstrap required, opened a new log
I20260928 13:06:50.132306 20567 ts_tablet_manager.cc:1397] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260928 13:06:50.132351 20568 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: No bootstrap required, opened a new log
I20260928 13:06:50.132426 20568 ts_tablet_manager.cc:1397] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:06:50.132448 20569 tablet_bootstrap.cc:492] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: No bootstrap required, opened a new log
I20260928 13:06:50.132573 20569 ts_tablet_manager.cc:1397] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:06:50.133867 20567 raft_consensus.cc:348] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.134032 20567 raft_consensus.cc:374] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.134073 20567 raft_consensus.cc:729] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ba96fd996f2492fa46c0e0264f7f58f, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.134179 20567 consensus_queue.cc:260] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.134477 20567 ts_tablet_manager.cc:1428] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:50.134407 20568 raft_consensus.cc:348] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.134486 20569 raft_consensus.cc:348] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.134593 20568 raft_consensus.cc:374] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.134626 20569 raft_consensus.cc:374] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.134626 20419 heartbeater.cc:503] Master 127.3.6.62:35677 was elected leader, sending a full tablet report...
I20260928 13:06:50.134631 20568 raft_consensus.cc:729] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a29485ae41e94129a910463023a63a2a, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.134660 20569 raft_consensus.cc:729] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16c0ff26006d4d249f9443568c0466e3, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.134739 20568 consensus_queue.cc:260] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.134785 20569 consensus_queue.cc:260] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.135003 20568 ts_tablet_manager.cc:1428] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20260928 13:06:50.135003 20569 ts_tablet_manager.cc:1428] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: Time spent starting tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:06:50.135147 20553 heartbeater.cc:503] Master 127.3.6.62:35677 was elected leader, sending a full tablet report...
I20260928 13:06:50.135176 20285 heartbeater.cc:503] Master 127.3.6.62:35677 was elected leader, sending a full tablet report...
W20260928 13:06:50.188247 20420 tablet.cc:2369] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:06:50.212317 20574 raft_consensus.cc:482] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:50.212440 20574 raft_consensus.cc:504] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.212849 20574 leader_election.cc:288] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16c0ff26006d4d249f9443568c0466e3 (127.3.6.1:46341), 1ba96fd996f2492fa46c0e0264f7f58f (127.3.6.2:41725)
I20260928 13:06:50.215647 20555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.213003 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46341 (local address 127.3.6.3:46741)
0928 13:06:50.213077 (+    74us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.213090 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.213162 (+    72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.213320 (+   158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.213322 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.213323 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.213400 (+    77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.213402 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.214042 (+   640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.214043 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.214782 (+   739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.214783 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.215372 (+   589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.215373 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.215454 (+    81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.215457 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.215534 (+    77us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.215576 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260928 13:06:50.215646 20565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.213142 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:46741 (local address 127.3.6.1:46341)
0928 13:06:50.213200 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.213202 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.213210 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:06:50.213239 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.213240 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.213252 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.213306 (+    54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.213477 (+   171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.213955 (+   478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.214883 (+   928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.215288 (+   405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.215372 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.215382 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.215542 (+   160us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.215580 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:06:50.215921 20563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.213120 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:42399 (local address 127.3.6.2:41725)
0928 13:06:50.213164 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.213166 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.213400 (+   234us) server_negotiation.cc:407] Connection header received
0928 13:06:50.213472 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.213473 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.213484 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.213556 (+    72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.213710 (+   154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.214167 (+   457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.215144 (+   977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.215521 (+   377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.215615 (+    94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.215624 (+     9us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.215807 (+   183us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.215856 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:06:50.216010 20239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c5c4ed9ae4411091e513259f6c8088" candidate_uuid: "a29485ae41e94129a910463023a63a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c0ff26006d4d249f9443568c0466e3" is_pre_election: true
I20260928 13:06:50.216156 20576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.213001 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41725 (local address 127.3.6.3:42399)
0928 13:06:50.213342 (+   341us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.213351 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.213405 (+    54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.213558 (+   153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.213559 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.213560 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.213629 (+    69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.213631 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.214253 (+   622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.214254 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.215001 (+   747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.215002 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.215617 (+   615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.215618 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.215689 (+    71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.215693 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.216020 (+   327us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.216062 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"mutex_wait_us":171,"thread_start_us":114,"threads_started":1}
I20260928 13:06:50.216169 20239 raft_consensus.cc:2454] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29485ae41e94129a910463023a63a2a in term 0.
I20260928 13:06:50.216456 20441 leader_election.cc:302] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16c0ff26006d4d249f9443568c0466e3, a29485ae41e94129a910463023a63a2a; no voters: 
I20260928 13:06:50.216497 20373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c5c4ed9ae4411091e513259f6c8088" candidate_uuid: "a29485ae41e94129a910463023a63a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" is_pre_election: true
I20260928 13:06:50.216580 20574 raft_consensus.cc:2781] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:50.216626 20574 raft_consensus.cc:482] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:50.216660 20574 raft_consensus.cc:3037] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.216679 20373 raft_consensus.cc:2454] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a29485ae41e94129a910463023a63a2a in term 0.
I20260928 13:06:50.217428 20574 raft_consensus.cc:504] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.217569 20574 leader_election.cc:288] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [CANDIDATE]: Term 1 election: Requested vote from peers 16c0ff26006d4d249f9443568c0466e3 (127.3.6.1:46341), 1ba96fd996f2492fa46c0e0264f7f58f (127.3.6.2:41725)
I20260928 13:06:50.217715 20373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c5c4ed9ae4411091e513259f6c8088" candidate_uuid: "a29485ae41e94129a910463023a63a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ba96fd996f2492fa46c0e0264f7f58f"
I20260928 13:06:50.217794 20373 raft_consensus.cc:3037] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.217756 20239 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c5c4ed9ae4411091e513259f6c8088" candidate_uuid: "a29485ae41e94129a910463023a63a2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16c0ff26006d4d249f9443568c0466e3"
I20260928 13:06:50.217842 20239 raft_consensus.cc:3037] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.218508 20373 raft_consensus.cc:2454] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29485ae41e94129a910463023a63a2a in term 1.
I20260928 13:06:50.218575 20239 raft_consensus.cc:2454] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a29485ae41e94129a910463023a63a2a in term 1.
I20260928 13:06:50.218719 20440 leader_election.cc:302] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ba96fd996f2492fa46c0e0264f7f58f, a29485ae41e94129a910463023a63a2a; no voters: 
I20260928 13:06:50.218822 20574 raft_consensus.cc:2781] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:50.218976 20574 raft_consensus.cc:686] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 1 LEADER]: Becoming Leader. State: Replica: a29485ae41e94129a910463023a63a2a, State: Running, Role: LEADER
I20260928 13:06:50.219099 20574 consensus_queue.cc:237] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } }
I20260928 13:06:50.219903 20094 catalog_manager.cc:5495] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a reported cstate change: term changed from 0 to 1, leader changed from <none> to a29485ae41e94129a910463023a63a2a (127.3.6.3). New cstate: current_term: 1 leader_uuid: "a29485ae41e94129a910463023a63a2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a29485ae41e94129a910463023a63a2a" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 37337 } health_report { overall_health: HEALTHY } } }
I20260928 13:06:50.240702 20566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.238377 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48350 (local address 127.3.6.3:37337)
0928 13:06:50.238443 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.238445 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.238456 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:50.238512 (+    56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.238513 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.238533 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.238592 (+    59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:50.238776 (+   184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.239285 (+   509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.240036 (+   751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.240219 (+   183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.240269 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.240421 (+   152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:50.240520 (+    99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:50.240582 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.240618 (+    36us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.240636 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:06:50.242652 20239 raft_consensus.cc:1261] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 1 FOLLOWER]: Refusing update from remote peer a29485ae41e94129a910463023a63a2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:50.242668 20373 raft_consensus.cc:1261] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 1 FOLLOWER]: Refusing update from remote peer a29485ae41e94129a910463023a63a2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:50.243049 20577 consensus_queue.cc:1035] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "16c0ff26006d4d249f9443568c0466e3" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 46341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:50.243198 20574 consensus_queue.cc:1035] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ba96fd996f2492fa46c0e0264f7f58f" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 41725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:50.245560 20580 mvcc.cc:205] Tried to move back new op lower bound from 7334300918751043584 to 7334300918658199552. Current Snapshot: MvccSnapshot[applied={T|T < 7334300918751043584}]
I20260928 13:06:50.245635 20582 mvcc.cc:205] Tried to move back new op lower bound from 7334300918751043584 to 7334300918658199552. Current Snapshot: MvccSnapshot[applied={T|T < 7334300918751043584}]
I20260928 13:06:50.245810 20581 mvcc.cc:205] Tried to move back new op lower bound from 7334300918751043584 to 7334300918658199552. Current Snapshot: MvccSnapshot[applied={T|T < 7334300918751043584}]
I20260928 13:06:50.247854 20093 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:50.247954 20093 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46710:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:50.248749 20093 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3a7a56861da407ab3107b050056d9ca: Sending DeleteTablet for 3 replicas of tablet 75c5c4ed9ae4411091e513259f6c8088
I20260928 13:06:50.249049 20219 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:45456
I20260928 13:06:50.249164 20487 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:48348
I20260928 13:06:50.249162 20353 tablet_service.cc:1514] Processing DeleteTablet for tablet 75c5c4ed9ae4411091e513259f6c8088 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:34990
I20260928 13:06:50.249253 20590 tablet_replica.cc:330] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3: stopping tablet replica
I20260928 13:06:50.249341 20590 raft_consensus.cc:2229] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:50.249437 20590 raft_consensus.cc:2258] T 75c5c4ed9ae4411091e513259f6c8088 P 16c0ff26006d4d249f9443568c0466e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:50.249637  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20156
W20260928 13:06:50.254890 20079 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:46341 (error 108)
I20260928 13:06:50.254945 20591 tablet_replica.cc:330] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: stopping tablet replica
I20260928 13:06:50.255071 20591 raft_consensus.cc:2229] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:50.255191 20591 raft_consensus.cc:2258] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:50.255348 20592 tablet_replica.cc:330] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: stopping tablet replica
I20260928 13:06:50.255447 20592 raft_consensus.cc:2229] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:50.255545 20592 raft_consensus.cc:2258] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:50.255836 20591 ts_tablet_manager.cc:1905] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:50.256062 20592 ts_tablet_manager.cc:1905] T 75c5c4ed9ae4411091e513259f6c8088 P 1ba96fd996f2492fa46c0e0264f7f58f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:50.256266  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20290
I20260928 13:06:50.257474 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.257346 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:46341 (local address 127.0.0.1:45460)
0928 13:06:50.257400 (+    54us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.257438 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46341: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 13:06:50.257611 20079 catalog_manager.cc:4584] TS 16c0ff26006d4d249f9443568c0466e3 (127.3.6.1:46341): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75c5c4ed9ae4411091e513259f6c8088: Network error: Client connection negotiation failed: client connection to 127.3.6.1:46341: connect: Connection refused (error 111)
I20260928 13:06:50.259079 20591 ts_tablet_manager.cc:1918] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:50.259243 20591 log.cc:1196] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/75c5c4ed9ae4411091e513259f6c8088
I20260928 13:06:50.259600 20591 ts_tablet_manager.cc:1939] T 75c5c4ed9ae4411091e513259f6c8088 P a29485ae41e94129a910463023a63a2a: Deleting consensus metadata
I20260928 13:06:50.260068 20081 catalog_manager.cc:4841] TS a29485ae41e94129a910463023a63a2a (127.3.6.3:37337): tablet 75c5c4ed9ae4411091e513259f6c8088 (table test-table [id=577fa4ca600f4a6d8251c170c2bfaad4]) successfully deleted
I20260928 13:06:50.261672 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.261541 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:41725 (local address 127.0.0.1:34994)
0928 13:06:50.261598 (+    57us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.261627 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:41725: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260928 13:06:50.261691  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20424
I20260928 13:06:50.266325  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20062
2026-09-28T13:06:50Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1937 ms)
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-28T13:06:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:50Z Disabled control of system clock
I20260928 13:06:50.293713  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37381
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:37277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:50.374646 20597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:50.374872 20597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:50.374894 20597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:50.376004 20597 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:50.376041 20597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:50.376055 20597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:50.376067 20597 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:50.376080 20597 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:50.377447 20597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37381
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:50.377664 20597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:50.377902 20597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:50.382552 20602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.382728 20597 server_base.cc:1034] running on GCE node
W20260928 13:06:50.382584 20605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.382572 20603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.383096 20597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:50.383476 20597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:50.384646 20597 hybrid_clock.cc:648] HybridClock initialized: now 1790600810384621 us; error 29 us; skew 500 ppm
I20260928 13:06:50.385842 20597 webserver.cc:460] Webserver started at http://127.3.6.62:41365/ using document root <none> and password file <none>
I20260928 13:06:50.386072 20597 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:50.386116 20597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:50.386207 20597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:50.387286 20597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "f42441b476db4e909546bc185a6ab788"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "e005f65185ffb63ac662731918c94d2b"
server_key_iv: "1aeec085b420305970f3c81c2b7bc343"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.387651 20597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "f42441b476db4e909546bc185a6ab788"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "e005f65185ffb63ac662731918c94d2b"
server_key_iv: "1aeec085b420305970f3c81c2b7bc343"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.388864 20597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:50.389499 20611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.389681 20597 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.389789 20597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "f42441b476db4e909546bc185a6ab788"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "e005f65185ffb63ac662731918c94d2b"
server_key_iv: "1aeec085b420305970f3c81c2b7bc343"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.389861 20597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:50.416812 20597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:50.417163 20597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:50.417317 20597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:50.421388 20597 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:37381
I20260928 13:06:50.421423 20663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:37381 every 8 connection(s)
I20260928 13:06:50.421783 20597 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:50.422752 20664 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.425099 20664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: Bootstrap starting.
I20260928 13:06:50.425696 20664 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.426010 20664 log.cc:824] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.426687 20664 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: No bootstrap required, opened a new log
I20260928 13:06:50.428174  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20597
I20260928 13:06:50.428295  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:50.428483  3096 external_mini_cluster.cc:1428] Setting key ca2fdc7bafd59c10ec48593332e36701
I20260928 13:06:50.428347 20664 raft_consensus.cc:348] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } }
I20260928 13:06:50.428542 20664 raft_consensus.cc:374] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.428606 20664 raft_consensus.cc:729] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f42441b476db4e909546bc185a6ab788, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.428757 20664 consensus_queue.cc:260] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } }
I20260928 13:06:50.428855 20664 raft_consensus.cc:388] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:50.428901 20664 raft_consensus.cc:482] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:50.428948 20664 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.429621 20664 raft_consensus.cc:504] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } }
I20260928 13:06:50.429729 20664 leader_election.cc:302] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f42441b476db4e909546bc185a6ab788; no voters: 
I20260928 13:06:50.429904 20664 leader_election.cc:288] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:50.429929 20669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:50.430037 20669 raft_consensus.cc:686] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [term 1 LEADER]: Becoming Leader. State: Replica: f42441b476db4e909546bc185a6ab788, State: Running, Role: LEADER
I20260928 13:06:50.430168 20664 sys_catalog.cc:564] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:50.430173 20669 consensus_queue.cc:237] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } }
I20260928 13:06:50.430673 20670 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f42441b476db4e909546bc185a6ab788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } } }
I20260928 13:06:50.430756 20670 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:50.430704 20671 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f42441b476db4e909546bc185a6ab788. Latest consensus state: current_term: 1 leader_uuid: "f42441b476db4e909546bc185a6ab788" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42441b476db4e909546bc185a6ab788" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37381 } } }
I20260928 13:06:50.430820 20671 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:50.430991 20677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:50.431559 20677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:50.433180 20677 catalog_manager.cc:1347] Generated new cluster ID: d223d2c94402413793a27a9a300f2069
I20260928 13:06:50.433234 20677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:50.434973 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.428999 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60276 (local address 127.3.6.62:37381)
0928 13:06:50.429217 (+   218us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.429227 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.429260 (+    33us) server_negotiation.cc:407] Connection header received
0928 13:06:50.429386 (+   126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.429393 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.429478 (+    85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.429640 (+   162us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.429913 (+   273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.431664 (+  1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.432580 (+   916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.433255 (+   675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.433415 (+   160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.434154 (+   739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.434158 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.434159 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:50.434367 (+   208us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.434408 (+    41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:50.434424 (+    16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.434497 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.434569 (+    72us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.434763 (+   194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260928 13:06:50.452419 20677 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:50.452987 20677 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:50.457993 20677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: Generated new TSK 0
I20260928 13:06:50.458236 20677 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:06:50.464242  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--builtin_ntp_servers=127.3.6.20:37277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:50.571866 20688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:50.572084 20688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:50.572108 20688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:50.573318 20688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:50.573364 20688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:50.573390 20688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:50.575230 20688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:50.575502 20688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:50.575884 20688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:50.580963 20693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.580993 20696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.581198 20694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.581966 20688 server_base.cc:1034] running on GCE node
I20260928 13:06:50.582231 20688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:50.582515 20688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:50.583685 20688 hybrid_clock.cc:648] HybridClock initialized: now 1790600810583669 us; error 36 us; skew 500 ppm
I20260928 13:06:50.585048 20688 webserver.cc:460] Webserver started at http://127.3.6.1:38869/ using document root <none> and password file <none>
I20260928 13:06:50.585311 20688 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:50.585379 20688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:50.585523 20688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:50.586684 20688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "45b7d004b9a940a9a90d0f26e30dab82"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "f89d1c246fee145222dab74279291bb9"
server_key_iv: "0f80477556239f23e605565320dbcf6b"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.587093 20688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "45b7d004b9a940a9a90d0f26e30dab82"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "f89d1c246fee145222dab74279291bb9"
server_key_iv: "0f80477556239f23e605565320dbcf6b"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.588397 20688 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:50.589203 20702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.589457 20688 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:50.589551 20688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "45b7d004b9a940a9a90d0f26e30dab82"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "f89d1c246fee145222dab74279291bb9"
server_key_iv: "0f80477556239f23e605565320dbcf6b"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.589617 20688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:50.612679 20688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:50.612958 20688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:50.613063 20688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:50.613269 20688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:50.613547 20688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:50.613574 20688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.613601 20688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:50.613616 20688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.619482 20688 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:34579
I20260928 13:06:50.619571 20815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:34579 every 8 connection(s)
I20260928 13:06:50.619911 20688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:50.621658  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20688
I20260928 13:06:50.621760  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:06:50.621971  3096 external_mini_cluster.cc:1428] Setting key d2b7360e45c43e7808f09d6853033193
I20260928 13:06:50.623001  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--builtin_ntp_servers=127.3.6.20:37277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260928 13:06:50.626122 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.620684 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:36041 (local address 127.3.6.62:37381)
0928 13:06:50.620757 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.620760 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.621010 (+   250us) server_negotiation.cc:407] Connection header received
0928 13:06:50.621617 (+   607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.621619 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.621632 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.621684 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.622547 (+   863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.623364 (+   817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.624605 (+  1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.624810 (+   205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.624870 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.625845 (+   975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.625846 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.625847 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:50.625852 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.625866 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:50.625870 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.625916 (+    46us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.626021 (+   105us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.626054 (+    33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:06:50.626417 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.620676 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37381 (local address 127.3.6.1:36041)
0928 13:06:50.620872 (+   196us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.620918 (+    46us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.621497 (+   579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.621820 (+   323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.621824 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.621836 (+    12us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:50.622474 (+   638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.622480 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.623461 (+   981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.623462 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.624509 (+  1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.624512 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.624897 (+   385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.624909 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.625085 (+   176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.625684 (+   599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:50.625684 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:50.625725 (+    41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:50.625754 (+    29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:50.625934 (+   180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:50.625940 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:50.625943 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.626013 (+    70us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.626137 (+   124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":74,"threads_started":1}
I20260928 13:06:50.627051 20816 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37381
I20260928 13:06:50.627156 20816 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:50.627373 20816 heartbeater.cc:511] Master 127.3.6.62:37381 requested a full tablet report, sending...
I20260928 13:06:50.627908 20628 ts_manager.cc:194] Registered new tserver with Master: 45b7d004b9a940a9a90d0f26e30dab82 (127.3.6.1:34579)
I20260928 13:06:50.628574 20628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.1:36041
W20260928 13:06:50.705041 20819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:50.705276 20819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:50.705312 20819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:50.706492 20819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:50.706555 20819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:50.706596 20819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:50.708057 20819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:50.708315 20819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:50.708666 20819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:50.713572 20827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.713578 20825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.713587 20824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.713864 20819 server_base.cc:1034] running on GCE node
I20260928 13:06:50.714087 20819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:50.714325 20819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:50.715481 20819 hybrid_clock.cc:648] HybridClock initialized: now 1790600810715478 us; error 37 us; skew 500 ppm
I20260928 13:06:50.716713 20819 webserver.cc:460] Webserver started at http://127.3.6.2:34109/ using document root <none> and password file <none>
I20260928 13:06:50.716959 20819 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:50.717028 20819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:50.717185 20819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:50.718267 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "c25985332b664b60a1e3cdf1ee096235"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "413cfbd494938d5c620d6dd379e29233"
server_key_iv: "757e3bcf46d41e335aeba64b8444aa21"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.718617 20819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "c25985332b664b60a1e3cdf1ee096235"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "413cfbd494938d5c620d6dd379e29233"
server_key_iv: "757e3bcf46d41e335aeba64b8444aa21"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.719969 20819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:50.720642 20833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.720808 20819 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:06:50.720908 20819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "c25985332b664b60a1e3cdf1ee096235"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "413cfbd494938d5c620d6dd379e29233"
server_key_iv: "757e3bcf46d41e335aeba64b8444aa21"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.720986 20819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:50.730540 20819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:50.730829 20819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:50.730973 20819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:50.731225 20819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:50.731586 20819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:50.731654 20819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.731698 20819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:50.731734 20819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.737398 20819 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:43207
I20260928 13:06:50.737442 20946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:43207 every 8 connection(s)
I20260928 13:06:50.737766 20819 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:50.738318  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20819
I20260928 13:06:50.738438  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:50.738634  3096 external_mini_cluster.cc:1428] Setting key 6b16d1febeb9a776482747f953c8b819
I20260928 13:06:50.739676  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--builtin_ntp_servers=127.3.6.20:37277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260928 13:06:50.743203 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.738422 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:48003 (local address 127.3.6.62:37381)
0928 13:06:50.738471 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.738473 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.738739 (+   266us) server_negotiation.cc:407] Connection header received
0928 13:06:50.739400 (+   661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.739401 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.739413 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.739456 (+    43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.740204 (+   748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.740710 (+   506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.741708 (+   998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.741912 (+   204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.741999 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.742872 (+   873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.742873 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.742874 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:50.742879 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.742896 (+    17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:50.742900 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.742972 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.743094 (+   122us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.743124 (+    30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:06:50.743414 20949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.738434 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37381 (local address 127.3.6.2:48003)
0928 13:06:50.738609 (+   175us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.738651 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.739268 (+   617us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.739523 (+   255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.739527 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.739544 (+    17us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:50.740110 (+   566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.740116 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.740808 (+   692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.740809 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.741606 (+   797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.741608 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.741998 (+   390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.742010 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.742146 (+   136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.742708 (+   562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:50.742708 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:50.742739 (+    31us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:50.742764 (+    25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:50.742972 (+   208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:50.742979 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:50.742982 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.743104 (+   122us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.743209 (+   105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260928 13:06:50.743878 20947 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37381
I20260928 13:06:50.743988 20947 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:50.744215 20947 heartbeater.cc:511] Master 127.3.6.62:37381 requested a full tablet report, sending...
I20260928 13:06:50.744578 20628 ts_manager.cc:194] Registered new tserver with Master: c25985332b664b60a1e3cdf1ee096235 (127.3.6.2:43207)
I20260928 13:06:50.744947 20628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.2:48003
W20260928 13:06:50.824081 20950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:50.824293 20950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:50.824313 20950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:50.825491 20950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:50.825541 20950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:50.825567 20950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:50.826903 20950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:37381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:50.827168 20950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:50.827461 20950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:50.832593 20955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.832630 20956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:50.832662 20958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:50.832903 20950 server_base.cc:1034] running on GCE node
I20260928 13:06:50.833114 20950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:50.833364 20950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:50.834528 20950 hybrid_clock.cc:648] HybridClock initialized: now 1790600810834527 us; error 43 us; skew 500 ppm
I20260928 13:06:50.835806 20950 webserver.cc:460] Webserver started at http://127.3.6.3:38385/ using document root <none> and password file <none>
I20260928 13:06:50.836056 20950 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:50.836126 20950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:50.836282 20950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:50.837303 20950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "8429c00fe9114f9ba67535593329323b"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "ec934f30877823d0bac930a996621ef9"
server_key_iv: "69f9c71ffeb3082d10e57d92abd46a2d"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.837654 20950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "8429c00fe9114f9ba67535593329323b"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "ec934f30877823d0bac930a996621ef9"
server_key_iv: "69f9c71ffeb3082d10e57d92abd46a2d"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.838953 20950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:50.839784 20964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.839975 20950 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:06:50.840072 20950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "8429c00fe9114f9ba67535593329323b"
format_stamp: "Formatted at 2026-09-28 13:06:50 on dist-test-slave-ddvw"
server_key: "ec934f30877823d0bac930a996621ef9"
server_key_iv: "69f9c71ffeb3082d10e57d92abd46a2d"
server_key_version: "encryptionkey@0"
I20260928 13:06:50.840154 20950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:50.850657 20950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:50.850956 20950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:50.851130 20950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:50.851354 20950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:50.851660 20950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:50.851712 20950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.851761 20950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:50.851785 20950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:50.857472 20950 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:45537
I20260928 13:06:50.857546 21077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:45537 every 8 connection(s)
I20260928 13:06:50.857877 20950 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:50.863185 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.858629 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:57195 (local address 127.3.6.62:37381)
0928 13:06:50.858698 (+    69us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.858699 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.858941 (+   242us) server_negotiation.cc:407] Connection header received
0928 13:06:50.859489 (+   548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.859491 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.859536 (+    45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.859591 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.860239 (+   648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.860785 (+   546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.861784 (+   999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.861986 (+   202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.862057 (+    71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.862869 (+   812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.862871 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.862871 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:50.862876 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.862892 (+    16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:50.862896 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.862940 (+    44us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.863081 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.863114 (+    33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:06:50.863451 21080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.858651 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37381 (local address 127.3.6.3:57195)
0928 13:06:50.858816 (+   165us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.858850 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.859392 (+   542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.859644 (+   252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.859647 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.859656 (+     9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:50.860154 (+   498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.860158 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.860876 (+   718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.860877 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.861681 (+   804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.861683 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.862060 (+   377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.862071 (+    11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.862185 (+   114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.862708 (+   523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:50.862709 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:50.862754 (+    45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:50.862778 (+    24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:50.862955 (+   177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:50.862959 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:50.862962 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.863081 (+   119us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.863186 (+   105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
I20260928 13:06:50.864086 21078 heartbeater.cc:347] Connected to a master server at 127.3.6.62:37381
I20260928 13:06:50.864216 21078 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:50.864383  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 20950
I20260928 13:06:50.864435 21078 heartbeater.cc:511] Master 127.3.6.62:37381 requested a full tablet report, sending...
I20260928 13:06:50.864476  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:50.864754  3096 external_mini_cluster.cc:1428] Setting key c6b9651aad5209fa90e31a83bc4834d3
I20260928 13:06:50.864897 20628 ts_manager.cc:194] Registered new tserver with Master: 8429c00fe9114f9ba67535593329323b (127.3.6.3:45537)
I20260928 13:06:50.865424 20628 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.3:57195
I20260928 13:06:50.865795  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:50.869998 20668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.867262 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60278 (local address 127.3.6.62:37381)
0928 13:06:50.867328 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.867331 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.867426 (+    95us) server_negotiation.cc:407] Connection header received
0928 13:06:50.867470 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.867471 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.867482 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.867531 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:50.867651 (+   120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.868100 (+   449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.868836 (+   736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.869017 (+   181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.869070 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.869721 (+   651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:50.869722 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:50.869723 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:50.869727 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:50.869741 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:50.869745 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:50.869800 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.869847 (+    47us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.869870 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 13:06:50.871691 20627 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60278:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:50.873210 20627 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:50.879746 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.875763 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56384 (local address 127.3.6.2:43207)
0928 13:06:50.875959 (+   196us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.875962 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.875971 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:06:50.876004 (+    33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.876006 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.876019 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.876112 (+    93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.876311 (+   199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877242 (+   931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.878662 (+  1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879333 (+   671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879432 (+    99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879538 (+   106us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.879624 (+    86us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.879664 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":92,"threads_started":1}
I20260928 13:06:50.879733 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.875597 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43207 (local address 127.0.0.1:56384)
0928 13:06:50.875766 (+   169us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.875776 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.875824 (+    48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.876123 (+   299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.876126 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.876128 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.876214 (+    86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.876223 (+     9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877326 (+  1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.877327 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.878574 (+  1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.878576 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879435 (+   859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879436 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.879511 (+    75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879524 (+    13us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.879600 (+    76us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.879652 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
I20260928 13:06:50.880092 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.876215 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54104 (local address 127.3.6.1:34579)
0928 13:06:50.876473 (+   258us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.876477 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.876487 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:50.876525 (+    38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.876538 (+    13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.876553 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.876632 (+    79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.876757 (+   125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877774 (+  1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.878889 (+  1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879593 (+   704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879858 (+   265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879948 (+    90us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.879973 (+    25us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.880009 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":82,"threads_started":1}
I20260928 13:06:50.880321 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.875824 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:34579 (local address 127.0.0.1:54104)
0928 13:06:50.875924 (+   100us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.875933 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.875970 (+    37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.876643 (+   673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.876644 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.876646 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.876688 (+    42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.876689 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877853 (+  1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.877854 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.878805 (+   951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.878807 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879686 (+   879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879687 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.879751 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879755 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.879788 (+    33us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.880092 (+   304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"mutex_wait_us":244,"thread_start_us":67,"threads_started":1}
I20260928 13:06:50.880609 20881 tablet_service.cc:1467] Processing CreateTablet for tablet 89e81303de1642518d404a9d2f9b30a1 (DEFAULT_TABLE table=test-table [id=f9419537948348fb948220314578cca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.880990 20881 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89e81303de1642518d404a9d2f9b30a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.881081 20750 tablet_service.cc:1467] Processing CreateTablet for tablet 89e81303de1642518d404a9d2f9b30a1 (DEFAULT_TABLE table=test-table [id=f9419537948348fb948220314578cca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.881417 20750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89e81303de1642518d404a9d2f9b30a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.883148 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.875553 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45537 (local address 127.0.0.1:45966)
0928 13:06:50.875685 (+   132us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.875728 (+    43us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.875795 (+    67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.876331 (+   536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.876332 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.876334 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.876377 (+    43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.876379 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877650 (+  1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.877651 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.878679 (+  1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.878680 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879692 (+  1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879693 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.879759 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879762 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.879809 (+    47us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.880068 (+   259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"mutex_wait_us":1,"thread_start_us":83,"threads_started":1}
I20260928 13:06:50.883608 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.875960 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45966 (local address 127.3.6.3:45537)
0928 13:06:50.876110 (+   150us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.876115 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.876127 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:06:50.876167 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.876169 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.876184 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.876262 (+    78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.876464 (+   202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.877564 (+  1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.878765 (+  1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.879499 (+   734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.879573 (+    74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.879664 (+    91us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.880138 (+   474us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.883496 (+  3358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260928 13:06:50.883952 21092 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Bootstrap starting.
I20260928 13:06:50.884363 21093 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: Bootstrap starting.
I20260928 13:06:50.884280 21012 tablet_service.cc:1467] Processing CreateTablet for tablet 89e81303de1642518d404a9d2f9b30a1 (DEFAULT_TABLE table=test-table [id=f9419537948348fb948220314578cca2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:50.884589 21012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89e81303de1642518d404a9d2f9b30a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:50.884640 21092 tablet_bootstrap.cc:654] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.884969 21093 tablet_bootstrap.cc:654] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.884954 21092 log.cc:824] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.885329 21093 log.cc:824] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.885792 21092 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: No bootstrap required, opened a new log
I20260928 13:06:50.885864 21092 ts_tablet_manager.cc:1397] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:50.886065 21093 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: No bootstrap required, opened a new log
I20260928 13:06:50.886145 21093 ts_tablet_manager.cc:1397] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:50.888039 21096 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Bootstrap starting.
I20260928 13:06:50.888271 21093 raft_consensus.cc:348] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.888461 21093 raft_consensus.cc:374] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.888514 21093 raft_consensus.cc:729] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45b7d004b9a940a9a90d0f26e30dab82, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.888638 21093 consensus_queue.cc:260] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.888767 21096 tablet_bootstrap.cc:654] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:50.888756 21092 raft_consensus.cc:348] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.888921 21092 raft_consensus.cc:374] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.888926 21093 ts_tablet_manager.cc:1428] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:50.888964 21092 raft_consensus.cc:729] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25985332b664b60a1e3cdf1ee096235, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.889063 20816 heartbeater.cc:503] Master 127.3.6.62:37381 was elected leader, sending a full tablet report...
I20260928 13:06:50.889081 21096 log.cc:824] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:50.889083 21092 consensus_queue.cc:260] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.889346 21092 ts_tablet_manager.cc:1428] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
I20260928 13:06:50.889432 20947 heartbeater.cc:503] Master 127.3.6.62:37381 was elected leader, sending a full tablet report...
I20260928 13:06:50.889967 21096 tablet_bootstrap.cc:492] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: No bootstrap required, opened a new log
I20260928 13:06:50.890040 21096 ts_tablet_manager.cc:1397] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:50.892545 21096 raft_consensus.cc:348] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.892693 21096 raft_consensus.cc:374] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:50.892716 21096 raft_consensus.cc:729] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8429c00fe9114f9ba67535593329323b, State: Initialized, Role: FOLLOWER
I20260928 13:06:50.892858 21096 consensus_queue.cc:260] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.893133 21096 ts_tablet_manager.cc:1428] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:50.893162 21078 heartbeater.cc:503] Master 127.3.6.62:37381 was elected leader, sending a full tablet report...
I20260928 13:06:50.901090 21097 raft_consensus.cc:482] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:50.901206 21097 raft_consensus.cc:504] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.901628 21097 leader_election.cc:288] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c25985332b664b60a1e3cdf1ee096235 (127.3.6.2:43207), 8429c00fe9114f9ba67535593329323b (127.3.6.3:45537)
I20260928 13:06:50.905431 21090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.901995 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:42041 (local address 127.3.6.3:45537)
0928 13:06:50.902044 (+    49us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.902046 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.902141 (+    95us) server_negotiation.cc:407] Connection header received
0928 13:06:50.902169 (+    28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.902170 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.902181 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.902233 (+    52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.902429 (+   196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.903103 (+   674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.904516 (+  1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.905070 (+   554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.905149 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.905159 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.905318 (+   159us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.905360 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 13:06:50.905431 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.901881 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:41705 (local address 127.3.6.2:43207)
0928 13:06:50.901928 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.901931 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.901985 (+    54us) server_negotiation.cc:407] Connection header received
0928 13:06:50.902092 (+   107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.902092 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.902134 (+    42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.902197 (+    63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:50.902358 (+   161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.903067 (+   709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.904517 (+  1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.905069 (+   552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.905149 (+    80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.905159 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.905318 (+   159us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.905363 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:06:50.905447 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.901808 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:43207 (local address 127.3.6.1:41705)
0928 13:06:50.901920 (+   112us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.901933 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.901989 (+    56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.902212 (+   223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.902213 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.902215 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.902292 (+    77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.902294 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.903139 (+   845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.903140 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.904419 (+  1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.904420 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.905159 (+   739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.905160 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.905236 (+    76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.905240 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.905298 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.905348 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":91}
I20260928 13:06:50.905453 21101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.901855 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:45537 (local address 127.3.6.1:42041)
0928 13:06:50.902063 (+   208us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.902071 (+     8us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:50.902124 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:50.902262 (+   138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:50.902263 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:50.902266 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:50.902350 (+    84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.902351 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.903192 (+   841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.903193 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.904416 (+  1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:50.904419 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.905172 (+   753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.905173 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:50.905236 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.905240 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:50.905298 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:06:50.905347 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":9,"thread_start_us":137,"threads_started":1}
I20260928 13:06:50.905889 20901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89e81303de1642518d404a9d2f9b30a1" candidate_uuid: "45b7d004b9a940a9a90d0f26e30dab82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25985332b664b60a1e3cdf1ee096235" is_pre_election: true
I20260928 13:06:50.906057 20901 raft_consensus.cc:2454] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b7d004b9a940a9a90d0f26e30dab82 in term 0.
I20260928 13:06:50.906020 21032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89e81303de1642518d404a9d2f9b30a1" candidate_uuid: "45b7d004b9a940a9a90d0f26e30dab82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8429c00fe9114f9ba67535593329323b" is_pre_election: true
I20260928 13:06:50.906193 21032 raft_consensus.cc:2454] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45b7d004b9a940a9a90d0f26e30dab82 in term 0.
I20260928 13:06:50.906330 20706 leader_election.cc:302] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b7d004b9a940a9a90d0f26e30dab82, c25985332b664b60a1e3cdf1ee096235; no voters: 
I20260928 13:06:50.906466 21097 raft_consensus.cc:2781] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:50.906527 21097 raft_consensus.cc:482] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:50.906545 21097 raft_consensus.cc:3037] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.907320 21097 raft_consensus.cc:504] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.907459 21097 leader_election.cc:288] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [CANDIDATE]: Term 1 election: Requested vote from peers c25985332b664b60a1e3cdf1ee096235 (127.3.6.2:43207), 8429c00fe9114f9ba67535593329323b (127.3.6.3:45537)
I20260928 13:06:50.907611 21032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89e81303de1642518d404a9d2f9b30a1" candidate_uuid: "45b7d004b9a940a9a90d0f26e30dab82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8429c00fe9114f9ba67535593329323b"
I20260928 13:06:50.907648 20901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89e81303de1642518d404a9d2f9b30a1" candidate_uuid: "45b7d004b9a940a9a90d0f26e30dab82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c25985332b664b60a1e3cdf1ee096235"
I20260928 13:06:50.907704 21032 raft_consensus.cc:3037] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.907744 20901 raft_consensus.cc:3037] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:50.908428 21032 raft_consensus.cc:2454] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b7d004b9a940a9a90d0f26e30dab82 in term 1.
I20260928 13:06:50.908556 20901 raft_consensus.cc:2454] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45b7d004b9a940a9a90d0f26e30dab82 in term 1.
I20260928 13:06:50.908620 20705 leader_election.cc:302] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45b7d004b9a940a9a90d0f26e30dab82, 8429c00fe9114f9ba67535593329323b; no voters: 
I20260928 13:06:50.908717 21097 raft_consensus.cc:2781] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:50.908885 21097 raft_consensus.cc:686] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [term 1 LEADER]: Becoming Leader. State: Replica: 45b7d004b9a940a9a90d0f26e30dab82, State: Running, Role: LEADER
I20260928 13:06:50.908996 21097 consensus_queue.cc:237] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } }
I20260928 13:06:50.909919 20627 catalog_manager.cc:5495] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45b7d004b9a940a9a90d0f26e30dab82 (127.3.6.1). New cstate: current_term: 1 leader_uuid: "45b7d004b9a940a9a90d0f26e30dab82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45b7d004b9a940a9a90d0f26e30dab82" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 34579 } health_report { overall_health: HEALTHY } } }
I20260928 13:06:50.914707 21091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.912587 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54118 (local address 127.3.6.1:34579)
0928 13:06:50.912631 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:50.912636 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:50.912645 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:06:50.912727 (+    82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:50.912728 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:50.912743 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:50.912799 (+    56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:50.912886 (+    87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.913330 (+   444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.914023 (+   693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:50.914202 (+   179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:50.914253 (+    51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:50.914387 (+   134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:50.914479 (+    92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:50.914539 (+    60us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:50.914569 (+    30us) server_negotiation.cc:299] Negotiation successful
0928 13:06:50.914585 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:06:50.916384 20901 raft_consensus.cc:1261] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 1 FOLLOWER]: Refusing update from remote peer 45b7d004b9a940a9a90d0f26e30dab82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:50.916399 21032 raft_consensus.cc:1261] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 1 FOLLOWER]: Refusing update from remote peer 45b7d004b9a940a9a90d0f26e30dab82: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:50.916738 21102 consensus_queue.cc:1035] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c25985332b664b60a1e3cdf1ee096235" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 43207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:50.916867 21097 consensus_queue.cc:1035] T 89e81303de1642518d404a9d2f9b30a1 P 45b7d004b9a940a9a90d0f26e30dab82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8429c00fe9114f9ba67535593329323b" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 45537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:50.919312 21105 mvcc.cc:205] Tried to move back new op lower bound from 7334300921511100416 to 7334300921484181504. Current Snapshot: MvccSnapshot[applied={T|T < 7334300921511100416}]
I20260928 13:06:50.919587 21107 mvcc.cc:205] Tried to move back new op lower bound from 7334300921511100416 to 7334300921484181504. Current Snapshot: MvccSnapshot[applied={T|T < 7334300921511100416}]
I20260928 13:06:50.922045 20627 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:50.922142 20627 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:50.922966 20627 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f42441b476db4e909546bc185a6ab788: Sending DeleteTablet for 3 replicas of tablet 89e81303de1642518d404a9d2f9b30a1
I20260928 13:06:50.923349 21012 tablet_service.cc:1514] Processing DeleteTablet for tablet 89e81303de1642518d404a9d2f9b30a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='slave'} at 127.0.0.1:45966
I20260928 13:06:50.923450 20881 tablet_service.cc:1514] Processing DeleteTablet for tablet 89e81303de1642518d404a9d2f9b30a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='slave'} at 127.0.0.1:56384
I20260928 13:06:50.923604  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20688
I20260928 13:06:50.923659 20750 tablet_service.cc:1514] Processing DeleteTablet for tablet 89e81303de1642518d404a9d2f9b30a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:50 UTC) from {username='slave'} at 127.0.0.1:54104
I20260928 13:06:50.924192 21115 tablet_replica.cc:330] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: stopping tablet replica
I20260928 13:06:50.924314 21115 raft_consensus.cc:2229] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:50.924441 21115 raft_consensus.cc:2258] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:50.924901 21115 ts_tablet_manager.cc:1905] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:50.925812 21114 tablet_replica.cc:330] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: stopping tablet replica
I20260928 13:06:50.925935 21114 raft_consensus.cc:2229] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:50.926054 21114 raft_consensus.cc:2258] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:50.926514 21114 ts_tablet_manager.cc:1905] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:50.926708 21115 ts_tablet_manager.cc:1918] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:50.926800 21115 log.cc:1196] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/89e81303de1642518d404a9d2f9b30a1
I20260928 13:06:50.927119 21115 ts_tablet_manager.cc:1939] T 89e81303de1642518d404a9d2f9b30a1 P c25985332b664b60a1e3cdf1ee096235: Deleting consensus metadata
I20260928 13:06:50.927529 20615 catalog_manager.cc:4841] TS c25985332b664b60a1e3cdf1ee096235 (127.3.6.2:43207): tablet 89e81303de1642518d404a9d2f9b30a1 (table test-table [id=f9419537948348fb948220314578cca2]) successfully deleted
I20260928 13:06:50.928416 21114 ts_tablet_manager.cc:1918] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:50.928506 21114 log.cc:1196] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/89e81303de1642518d404a9d2f9b30a1
I20260928 13:06:50.928758 21114 ts_tablet_manager.cc:1939] T 89e81303de1642518d404a9d2f9b30a1 P 8429c00fe9114f9ba67535593329323b: Deleting consensus metadata
I20260928 13:06:50.929147 20614 catalog_manager.cc:4841] TS 8429c00fe9114f9ba67535593329323b (127.3.6.3:45537): tablet 89e81303de1642518d404a9d2f9b30a1 (table test-table [id=f9419537948348fb948220314578cca2]) successfully deleted
W20260928 13:06:50.929750 20615 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:34579 (error 108)
I20260928 13:06:50.930029  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20819
I20260928 13:06:50.930626 21086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:50.930124 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:34579 (local address 127.0.0.1:54124)
0928 13:06:50.930532 (+   408us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:50.930577 (+    45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:34579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383}
W20260928 13:06:50.931092 20615 catalog_manager.cc:4584] TS 45b7d004b9a940a9a90d0f26e30dab82 (127.3.6.1:34579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89e81303de1642518d404a9d2f9b30a1: Network error: Client connection negotiation failed: client connection to 127.3.6.1:34579: connect: Connection refused (error 111)
I20260928 13:06:50.935287  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20950
I20260928 13:06:50.939827  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 20597
2026-09-28T13:06:50Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (672 ms)
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:50 dist-test-slave-ddvw krb5kdc[21119](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:50 dist-test-slave-ddvw krb5kdc[21119](info): set up 2 sockets
Sep 28 13:06:50 dist-test-slave-ddvw krb5kdc[21119](info): commencing operation
krb5kdc: starting...
W20260928 13:06:51.982751  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.023s	user 0.002s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:06:52.099671  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:33093
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:33093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:52.180332 21132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:52.180578 21132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:52.180603 21132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:52.181859 21132 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:52.181908 21132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:52.181922 21132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:52.181967 21132 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:52.181998 21132 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:52.183568 21132 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:33093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:33093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:52.183848 21132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:52.184103 21132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:52.189185 21140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.189250 21138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.189338 21132 server_base.cc:1034] running on GCE node
W20260928 13:06:52.189248 21137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.189687 21132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:52.189990 21132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:52.191192 21132 hybrid_clock.cc:648] HybridClock initialized: now 1790600812191172 us; error 39 us; skew 500 ppm
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:52.193779 21132 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:06:52.194255 21132 webserver.cc:460] Webserver started at http://127.3.6.62:33439/ using document root <none> and password file <none>
I20260928 13:06:52.194518 21132 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:52.194589 21132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:52.194737 21132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:52.195910 21132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "995710ca00eb438a8411106d8aa29a25"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "d65d632c5a2b2def07301146ecd20ef7"
server_key_iv: "830baf748bd617f596d6663b849c10fa"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.196295 21132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "995710ca00eb438a8411106d8aa29a25"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "d65d632c5a2b2def07301146ecd20ef7"
server_key_iv: "830baf748bd617f596d6663b849c10fa"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.197710 21132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260928 13:06:52.198488 21147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.198681 21132 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:06:52.198776 21132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "995710ca00eb438a8411106d8aa29a25"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "d65d632c5a2b2def07301146ecd20ef7"
server_key_iv: "830baf748bd617f596d6663b849c10fa"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.198865 21132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:52.215427 21132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:52.217900 21132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:52.218079 21132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:52.222064 21132 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:33093
I20260928 13:06:52.222100 21199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:33093 every 8 connection(s)
I20260928 13:06:52.222460 21132 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:52.223416 21200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:52.224133  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21132
I20260928 13:06:52.224241  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:52.224426  3096 external_mini_cluster.cc:1428] Setting key fc774906700107c52d1a3b6cc6f824dd
I20260928 13:06:52.227064 21200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: Bootstrap starting.
I20260928 13:06:52.227672 21200 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:52.227985 21200 log.cc:824] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:52.228659 21200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: No bootstrap required, opened a new log
I20260928 13:06:52.230445 21200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } }
I20260928 13:06:52.230605 21200 raft_consensus.cc:374] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:52.230654 21200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 995710ca00eb438a8411106d8aa29a25, State: Initialized, Role: FOLLOWER
I20260928 13:06:52.230814 21200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } }
I20260928 13:06:52.230917 21200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:52.230962 21200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:52.231032 21200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:52.231565 21200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } }
I20260928 13:06:52.231683 21200 leader_election.cc:302] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 995710ca00eb438a8411106d8aa29a25; no voters: 
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:52.231884 21200 leader_election.cc:288] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:52.231920 21205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:52.232120 21205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [term 1 LEADER]: Becoming Leader. State: Replica: 995710ca00eb438a8411106d8aa29a25, State: Running, Role: LEADER
I20260928 13:06:52.232153 21200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:52.232219 21205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } }
I20260928 13:06:52.232510 21205 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 995710ca00eb438a8411106d8aa29a25. Latest consensus state: current_term: 1 leader_uuid: "995710ca00eb438a8411106d8aa29a25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } } }
I20260928 13:06:52.232602 21205 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:52.232520 21207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "995710ca00eb438a8411106d8aa29a25" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "995710ca00eb438a8411106d8aa29a25" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 33093 } } }
I20260928 13:06:52.232983 21207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:52.233132 21214 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:52.233968 21214 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:52.235939 21214 catalog_manager.cc:1347] Generated new cluster ID: 53198f417cee4ea88fb48d5d9bae083b
I20260928 13:06:52.235989 21214 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:52.236368 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.225010 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60622 (local address 127.3.6.62:33093)
0928 13:06:52.225193 (+   183us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.225229 (+    36us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.225450 (+   221us) server_negotiation.cc:407] Connection header received
0928 13:06:52.226029 (+   579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.226039 (+    10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.226103 (+    64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.226250 (+   147us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.227138 (+   888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.228191 (+  1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.229110 (+   919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.229553 (+   443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.229671 (+   118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.232364 (+  2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.232369 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.232369 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:52.232396 (+    27us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.234554 (+  2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.234967 (+   413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.234970 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.234970 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.235108 (+   138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.235356 (+   248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.235377 (+    21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.235378 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.235693 (+   315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.235869 (+   176us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.236011 (+   142us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.236171 (+   160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":61,"threads_started":1}
I20260928 13:06:52.251183 21214 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:52.251981 21214 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:52.265892 21214 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: Generated new TSK 0
I20260928 13:06:52.266135 21214 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:06:52.291793  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:52.373768 21226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:52.374013 21226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:52.374054 21226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:52.375252 21226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:52.375317 21226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:52.375363 21226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:52.376813 21226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:52.377076 21226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:52.377307 21226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:52.382141 21234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.382151 21231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.382215 21232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.382503 21226 server_base.cc:1034] running on GCE node
I20260928 13:06:52.382671 21226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:52.382855 21226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:52.384006 21226 hybrid_clock.cc:648] HybridClock initialized: now 1790600812383983 us; error 40 us; skew 500 ppm
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:52.386699 21226 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:06:52.387219 21226 webserver.cc:460] Webserver started at http://127.3.6.1:39713/ using document root <none> and password file <none>
I20260928 13:06:52.387440 21226 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:52.387483 21226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:52.387621 21226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:52.388680 21226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "65253fabbd764ec8a7cf540f0499a147"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "9cfe6c7a0aa51c04d6c1a6322c23055f"
server_key_iv: "76fce41eefabb01c0aaa6cf4dcde3576"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.389051 21226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "65253fabbd764ec8a7cf540f0499a147"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "9cfe6c7a0aa51c04d6c1a6322c23055f"
server_key_iv: "76fce41eefabb01c0aaa6cf4dcde3576"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.390381 21226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:06:52.391216 21241 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.391386 21226 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:52.391489 21226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "65253fabbd764ec8a7cf540f0499a147"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "9cfe6c7a0aa51c04d6c1a6322c23055f"
server_key_iv: "76fce41eefabb01c0aaa6cf4dcde3576"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.391582 21226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:52.413352 21226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:52.415876 21226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:52.416056 21226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:52.416353 21226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:52.416678 21226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:52.416733 21226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.416769 21226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:52.416816 21226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.422756 21226 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:33025
I20260928 13:06:52.422801 21354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:33025 every 8 connection(s)
I20260928 13:06:52.423156 21226 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:52.427134  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21226
I20260928 13:06:52.427242  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:06:52.427456  3096 external_mini_cluster.cc:1428] Setting key b6d44650208f362efceb8c1806092f75
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:52.433369 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.423892 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:33093 (local address 127.3.6.1:52153)
0928 13:06:52.424086 (+   194us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.424123 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.424623 (+   500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.424826 (+   203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.424829 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.425384 (+   555us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:52.425588 (+   204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.425593 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.426247 (+   654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.426248 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.427150 (+   902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.427152 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.427628 (+   476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.427642 (+    14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.427799 (+   157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.428398 (+   599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:52.428406 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:52.429990 (+  1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:52.431840 (+  1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.431846 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.431848 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.432211 (+   363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.432420 (+   209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.432420 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.432420 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.432523 (+   103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.432817 (+   294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:52.432822 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:52.432940 (+   118us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.433041 (+   101us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.433158 (+   117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":108,"threads_started":1}
I20260928 13:06:52.433377 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.423914 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:52153 (local address 127.3.6.62:33093)
0928 13:06:52.424002 (+    88us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.424004 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.424207 (+   203us) server_negotiation.cc:407] Connection header received
0928 13:06:52.424705 (+   498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.424706 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.424716 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.424770 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.425661 (+   891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.426165 (+   504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.427243 (+  1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.427536 (+   293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.427629 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.430080 (+  2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.430081 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.430082 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:52.430090 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.431762 (+  1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.432281 (+   519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.432283 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.432283 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.432350 (+    67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.432588 (+   238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.432589 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.432590 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.432745 (+   155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.432812 (+    67us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.433091 (+   279us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.433239 (+   148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 13:06:52.434264 21355 heartbeater.cc:347] Connected to a master server at 127.3.6.62:33093
I20260928 13:06:52.434373 21355 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:52.434576 21355 heartbeater.cc:511] Master 127.3.6.62:33093 requested a full tablet report, sending...
I20260928 13:06:52.435177 21164 ts_manager.cc:194] Registered new tserver with Master: 65253fabbd764ec8a7cf540f0499a147 (127.3.6.1:33025)
I20260928 13:06:52.435794 21164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:52153
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:06:52.453400  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:52.538156 21360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:52.538401 21360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:52.538442 21360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:52.539606 21360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:52.539676 21360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:52.539721 21360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:52.541164 21360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21360
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:52.541425 21360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:52.541658 21360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:52.546654 21366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.546792 21360 server_base.cc:1034] running on GCE node
W20260928 13:06:52.546731 21368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.546653 21365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.547092 21360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:52.547340 21360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:52.548492 21360 hybrid_clock.cc:648] HybridClock initialized: now 1790600812548477 us; error 27 us; skew 500 ppm
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:52.550968 21360 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:06:52.551409 21360 webserver.cc:460] Webserver started at http://127.3.6.2:45015/ using document root <none> and password file <none>
I20260928 13:06:52.551584 21360 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:52.551625 21360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:52.551712 21360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:52.552697 21360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "1c5e7db3af1dd7b843e9e2bc9e2a23e4"
server_key_iv: "c90847d30dcf5c949367fac952628d9b"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.552996 21360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "1c5e7db3af1dd7b843e9e2bc9e2a23e4"
server_key_iv: "c90847d30dcf5c949367fac952628d9b"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.554277 21360 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:52.555004 21375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.555217 21360 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:06:52.555318 21360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "1c5e7db3af1dd7b843e9e2bc9e2a23e4"
server_key_iv: "c90847d30dcf5c949367fac952628d9b"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.555404 21360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:52.566838 21360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:52.569434 21360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:52.569625 21360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:52.569882 21360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:52.570231 21360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:52.570286 21360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.570322 21360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:52.570350 21360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.576668 21360 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44053
I20260928 13:06:52.576754 21488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44053 every 8 connection(s)
I20260928 13:06:52.577091 21360 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:52.578461  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21360
I20260928 13:06:52.578554  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:52.578779  3096 external_mini_cluster.cc:1428] Setting key 367457998537fd9269c3c896b40009ce
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
I20260928 13:06:52.587455 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.577849 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:35503 (local address 127.3.6.62:33093)
0928 13:06:52.577893 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.577895 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.578149 (+   254us) server_negotiation.cc:407] Connection header received
0928 13:06:52.578772 (+   623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.578774 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.578787 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.578859 (+    72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.580202 (+  1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.580747 (+   545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.581816 (+  1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.582030 (+   214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.582106 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.584351 (+  2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.584353 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.584353 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:52.584361 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.585875 (+  1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.586339 (+   464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.586340 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.586341 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.586402 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.586672 (+   270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.586673 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.586673 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.586835 (+   162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.586921 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.587272 (+   351us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.587359 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:06:52.587677 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.577838 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:33093 (local address 127.3.6.2:35503)
0928 13:06:52.578020 (+   182us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.578056 (+    36us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.578651 (+   595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.579065 (+   414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.579069 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.579782 (+   713us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:52.580067 (+   285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.580074 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.580863 (+   789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.580865 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.581702 (+   837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.581704 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.582114 (+   410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.582126 (+    12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.582250 (+   124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.582823 (+   573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:52.582832 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:52.584250 (+  1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:52.585971 (+  1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.585979 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.585981 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.586246 (+   265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.586482 (+   236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.586483 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.586484 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.586596 (+   112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.586911 (+   315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:52.586918 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:52.587134 (+   216us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.587249 (+   115us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.587420 (+   171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260928 13:06:52.588150 21489 heartbeater.cc:347] Connected to a master server at 127.3.6.62:33093
I20260928 13:06:52.588259 21489 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:52.588460 21489 heartbeater.cc:511] Master 127.3.6.62:33093 requested a full tablet report, sending...
I20260928 13:06:52.588881 21164 ts_manager.cc:194] Registered new tserver with Master: 4ce4b8d9d84c4051a5576b3b5a961fb0 (127.3.6.2:44053)
I20260928 13:06:52.589321 21164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:35503
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:06:52.604265  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:43917
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:52.684912 21494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:52.685118 21494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:52.685141 21494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:52.686292 21494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:52.686335 21494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:52.686390 21494 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:52.687822 21494 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:43917
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:33093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:52.688066 21494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:52.688308 21494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:52.693192 21499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.693190 21500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.693190 21502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.693528 21494 server_base.cc:1034] running on GCE node
I20260928 13:06:52.693737 21494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:52.693964 21494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:52.695073 21494 hybrid_clock.cc:648] HybridClock initialized: now 1790600812695060 us; error 34 us; skew 500 ppm
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:52.697546 21494 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:06:52.698019 21494 webserver.cc:460] Webserver started at http://127.3.6.3:38915/ using document root <none> and password file <none>
I20260928 13:06:52.698251 21494 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:52.698318 21494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:52.698493 21494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:52.699569 21494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "1194b7ed8dab48d0807352344fda9051"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "db58e362e2dcf4739b7889c98bf05c68"
server_key_iv: "9b33595157b902b8806ccb41d415f6de"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.699934 21494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "1194b7ed8dab48d0807352344fda9051"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "db58e362e2dcf4739b7889c98bf05c68"
server_key_iv: "9b33595157b902b8806ccb41d415f6de"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.701244 21494 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:52.701980 21509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.702153 21494 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:52.702250 21494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "1194b7ed8dab48d0807352344fda9051"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "db58e362e2dcf4739b7889c98bf05c68"
server_key_iv: "9b33595157b902b8806ccb41d415f6de"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.702337 21494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:52.713858 21494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:52.716221 21494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:52.716384 21494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:52.716619 21494 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:52.716921 21494 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:52.716974 21494 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.717007 21494 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:52.717036 21494 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.722908 21494 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:43515
I20260928 13:06:52.722955 21622 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:43515 every 8 connection(s)
I20260928 13:06:52.723291 21494 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:52.729391  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21494
I20260928 13:06:52.729521  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:52.729712  3096 external_mini_cluster.cc:1428] Setting key f172c948c8f6de59b152a3e3a1da7642
Sep 28 13:06:52 dist-test-slave-ddvw krb5kdc[21119](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600812, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:52.735404 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.724050 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:44191 (local address 127.3.6.62:33093)
0928 13:06:52.724115 (+    65us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.724116 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.724303 (+   187us) server_negotiation.cc:407] Connection header received
0928 13:06:52.724851 (+   548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.724853 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.724872 (+    19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.724935 (+    63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.725862 (+   927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.726569 (+   707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.728101 (+  1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.728439 (+   338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.728494 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.731856 (+  3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.731857 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.731858 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:52.731866 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.733846 (+  1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.734322 (+   476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.734323 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.734324 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.734383 (+    59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.734659 (+   276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.734660 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.734661 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.734784 (+   123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.734855 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.735219 (+   364us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.735303 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 13:06:52.735862 21625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.724022 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:33093 (local address 127.3.6.3:44191)
0928 13:06:52.724168 (+   146us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.724210 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.724750 (+   540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.724997 (+   247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.725001 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.725576 (+   575us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:52.725780 (+   204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.725784 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.726682 (+   898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.726684 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.727986 (+  1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.727990 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.728597 (+   607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.728610 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.728796 (+   186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.729945 (+  1149us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:52.729953 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:52.731738 (+  1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:52.733936 (+  2198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.733944 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.733968 (+    24us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.734224 (+   256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.734454 (+   230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:52.734455 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:52.734455 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:52.734583 (+   128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:52.734846 (+   263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:52.734852 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:52.735054 (+   202us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.735200 (+   146us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.735375 (+   175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":79,"threads_started":1}
I20260928 13:06:52.736428 21623 heartbeater.cc:347] Connected to a master server at 127.3.6.62:33093
I20260928 13:06:52.736532 21623 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:52.736756 21623 heartbeater.cc:511] Master 127.3.6.62:33093 requested a full tablet report, sending...
I20260928 13:06:52.737357 21164 ts_manager.cc:194] Registered new tserver with Master: 1194b7ed8dab48d0807352344fda9051 (127.3.6.3:43515)
I20260928 13:06:52.737843 21164 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:44191
I20260928 13:06:52.742064  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:52.752418 21203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.743882 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60634 (local address 127.3.6.62:33093)
0928 13:06:52.743948 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.743951 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.744022 (+    71us) server_negotiation.cc:407] Connection header received
0928 13:06:52.744101 (+    79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.744102 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.744113 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.744166 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.744895 (+   729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.745602 (+   707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.746715 (+  1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.747001 (+   286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.747114 (+   113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.748561 (+  1447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.748562 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.748562 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:52.748569 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.750504 (+  1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.751086 (+   582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.751087 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.751087 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.751156 (+    69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:52.751471 (+   315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:52.751472 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:52.751473 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:52.751681 (+   208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.751810 (+   129us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.752188 (+   378us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.752267 (+    79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 13:06:52.754413 21164 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:52.757259 21164 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:52.765983 21631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.760800 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:43515 (local address 127.0.0.1:50656)
0928 13:06:52.761149 (+   349us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.761158 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.761195 (+    37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.761790 (+   595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.761790 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.761792 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:52.761837 (+    45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.761838 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.763250 (+  1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.763251 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.764539 (+  1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.764541 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.765632 (+  1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.765634 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.765731 (+    97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.765750 (+    19us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.765806 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.765871 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":70,"threads_started":1}
I20260928 13:06:52.766501 21634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.761019 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50656 (local address 127.3.6.3:43515)
0928 13:06:52.761613 (+   594us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.761617 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.761627 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:52.761666 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.761668 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.761684 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.761787 (+   103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:52.761894 (+   107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.763161 (+  1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.764652 (+  1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.765524 (+   872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.766225 (+   701us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.766312 (+    87us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.766341 (+    29us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.766397 (+    56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":116,"threads_started":1}
I20260928 13:06:52.766842 21632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.760768 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:33025 (local address 127.0.0.1:49644)
0928 13:06:52.760892 (+   124us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.760937 (+    45us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.761020 (+    83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.761482 (+   462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.761486 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.761488 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:52.761573 (+    85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.761576 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.762980 (+  1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.762981 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.764419 (+  1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.764422 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.766605 (+  2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.766606 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.766669 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.766673 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.766701 (+    28us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.766743 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"mutex_wait_us":35,"thread_start_us":63,"threads_started":1}
I20260928 13:06:52.767311 21635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.761037 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49644 (local address 127.3.6.1:33025)
0928 13:06:52.761288 (+   251us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.761295 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.761306 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:52.761346 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.761348 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.761363 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.761469 (+   106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:52.761668 (+   199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.762852 (+  1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.765621 (+  2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.766501 (+   880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.767055 (+   554us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.767141 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.767171 (+    30us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.767215 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":105,"threads_started":1}
I20260928 13:06:52.767282 21557 tablet_service.cc:1467] Processing CreateTablet for tablet 9074f55c27bd43a7973add5a99347966 (DEFAULT_TABLE table=test-table [id=e20c98fb3a444250a2abef96aa19d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:52.767717 21557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9074f55c27bd43a7973add5a99347966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:52.768002 21636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.761251 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54604 (local address 127.3.6.2:44053)
0928 13:06:52.761412 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.761416 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.761426 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:52.761466 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.761468 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.761483 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.761563 (+    80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:52.761725 (+   162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.762850 (+  1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.765594 (+  2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.766756 (+  1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.767540 (+   784us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.767605 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.767855 (+   250us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.767902 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260928 13:06:52.767939 21289 tablet_service.cc:1467] Processing CreateTablet for tablet 9074f55c27bd43a7973add5a99347966 (DEFAULT_TABLE table=test-table [id=e20c98fb3a444250a2abef96aa19d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:52.768267 21289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9074f55c27bd43a7973add5a99347966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:52.768437 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.760787 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44053 (local address 127.0.0.1:54604)
0928 13:06:52.761065 (+   278us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.761076 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.761149 (+    73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.761579 (+   430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.761580 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.761582 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:52.761660 (+    78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.761662 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.762944 (+  1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.762945 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.765519 (+  2574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.765522 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.767641 (+  2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.767642 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.767704 (+    62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.767708 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.767759 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.768305 (+   546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":49,"threads_started":1}
I20260928 13:06:52.769212 21423 tablet_service.cc:1467] Processing CreateTablet for tablet 9074f55c27bd43a7973add5a99347966 (DEFAULT_TABLE table=test-table [id=e20c98fb3a444250a2abef96aa19d18e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:52.769546 21423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9074f55c27bd43a7973add5a99347966. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:52.771145 21637 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: Bootstrap starting.
I20260928 13:06:52.771870 21637 tablet_bootstrap.cc:654] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:52.772557 21637 log.cc:824] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:52.772837 21639 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Bootstrap starting.
I20260928 13:06:52.772913 21638 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Bootstrap starting.
I20260928 13:06:52.773487 21639 tablet_bootstrap.cc:654] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:52.773573 21638 tablet_bootstrap.cc:654] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:52.774035 21639 log.cc:824] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:52.774180 21638 log.cc:824] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:52.774768 21637 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: No bootstrap required, opened a new log
I20260928 13:06:52.774842 21637 ts_tablet_manager.cc:1397] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: Time spent bootstrapping tablet: real 0.004s	user 0.000s	sys 0.002s
I20260928 13:06:52.775096 21638 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: No bootstrap required, opened a new log
I20260928 13:06:52.775166 21638 ts_tablet_manager.cc:1397] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:52.775386 21639 tablet_bootstrap.cc:492] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: No bootstrap required, opened a new log
I20260928 13:06:52.775501 21639 ts_tablet_manager.cc:1397] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Time spent bootstrapping tablet: real 0.003s	user 0.001s	sys 0.000s
I20260928 13:06:52.776439 21638 raft_consensus.cc:348] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.776580 21638 raft_consensus.cc:374] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:52.776603 21638 raft_consensus.cc:729] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1194b7ed8dab48d0807352344fda9051, State: Initialized, Role: FOLLOWER
I20260928 13:06:52.776726 21638 consensus_queue.cc:260] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.776857 21637 raft_consensus.cc:348] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.777006 21623 heartbeater.cc:503] Master 127.3.6.62:33093 was elected leader, sending a full tablet report...
I20260928 13:06:52.777043 21637 raft_consensus.cc:374] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:52.777096 21637 raft_consensus.cc:729] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65253fabbd764ec8a7cf540f0499a147, State: Initialized, Role: FOLLOWER
I20260928 13:06:52.777248 21637 consensus_queue.cc:260] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.777509 21637 ts_tablet_manager.cc:1428] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: Time spent starting tablet: real 0.003s	user 0.002s	sys 0.000s
I20260928 13:06:52.777628 21355 heartbeater.cc:503] Master 127.3.6.62:33093 was elected leader, sending a full tablet report...
I20260928 13:06:52.778038 21639 raft_consensus.cc:348] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.778254 21639 raft_consensus.cc:374] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:52.778313 21639 raft_consensus.cc:729] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ce4b8d9d84c4051a5576b3b5a961fb0, State: Initialized, Role: FOLLOWER
I20260928 13:06:52.777010 21638 ts_tablet_manager.cc:1428] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:52.778424 21639 consensus_queue.cc:260] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.778712 21639 ts_tablet_manager.cc:1428] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Time spent starting tablet: real 0.003s	user 0.000s	sys 0.003s
I20260928 13:06:52.779103 21489 heartbeater.cc:503] Master 127.3.6.62:33093 was elected leader, sending a full tablet report...
I20260928 13:06:52.787758 21645 raft_consensus.cc:482] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:52.787891 21645 raft_consensus.cc:504] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.788734 21645 leader_election.cc:288] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65253fabbd764ec8a7cf540f0499a147 (127.3.6.1:33025), 1194b7ed8dab48d0807352344fda9051 (127.3.6.3:43515)
I20260928 13:06:52.791525 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.788438 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:43515 (local address 127.3.6.2:48451)
0928 13:06:52.788482 (+    44us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.788496 (+    14us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.788541 (+    45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.788696 (+   155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.788697 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.788698 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:52.788783 (+    85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.788785 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.789437 (+   652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.789439 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.790617 (+  1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.790620 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.791277 (+   657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.791278 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.791360 (+    82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.791364 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.791415 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.791457 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 13:06:52.791777 21634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.788550 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:48451 (local address 127.3.6.3:43515)
0928 13:06:52.788592 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.788593 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.788601 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:06:52.788627 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.788627 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.788638 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.788695 (+    57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:52.788861 (+   166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.789328 (+   467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.790704 (+  1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.791195 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.791279 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.791290 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.791670 (+   380us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.791719 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:06:52.792033 21577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9074f55c27bd43a7973add5a99347966" candidate_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1194b7ed8dab48d0807352344fda9051" is_pre_election: true
I20260928 13:06:52.792160 21577 raft_consensus.cc:2454] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce4b8d9d84c4051a5576b3b5a961fb0 in term 0.
I20260928 13:06:52.792353 21377 leader_election.cc:302] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1194b7ed8dab48d0807352344fda9051, 4ce4b8d9d84c4051a5576b3b5a961fb0; no voters: 
I20260928 13:06:52.792464 21645 raft_consensus.cc:2781] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:52.792497 21645 raft_consensus.cc:482] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:52.792517 21645 raft_consensus.cc:3037] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:52.793496 21645 raft_consensus.cc:504] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.793803 21577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9074f55c27bd43a7973add5a99347966" candidate_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1194b7ed8dab48d0807352344fda9051"
I20260928 13:06:52.793908 21577 raft_consensus.cc:3037] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:52.794775 21577 raft_consensus.cc:2454] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ce4b8d9d84c4051a5576b3b5a961fb0 in term 1.
I20260928 13:06:52.794962 21377 leader_election.cc:302] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1194b7ed8dab48d0807352344fda9051, 4ce4b8d9d84c4051a5576b3b5a961fb0; no voters: 
I20260928 13:06:52.795183 21645 leader_election.cc:288] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 65253fabbd764ec8a7cf540f0499a147 (127.3.6.1:33025), 1194b7ed8dab48d0807352344fda9051 (127.3.6.3:43515)
I20260928 13:06:52.795207 21646 raft_consensus.cc:2781] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:52.795348 21646 raft_consensus.cc:686] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 1 LEADER]: Becoming Leader. State: Replica: 4ce4b8d9d84c4051a5576b3b5a961fb0, State: Running, Role: LEADER
I20260928 13:06:52.795461 21646 consensus_queue.cc:237] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } }
I20260928 13:06:52.796326 21163 catalog_manager.cc:5495] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ce4b8d9d84c4051a5576b3b5a961fb0 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44053 } health_report { overall_health: HEALTHY } } }
I20260928 13:06:52.797998 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.794558 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:33025 (local address 127.3.6.2:42217)
0928 13:06:52.795058 (+   500us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.795070 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:52.795117 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:52.795299 (+   182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:52.795301 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:52.795302 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:52.795341 (+    39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.795343 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.796127 (+   784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.796128 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.797090 (+   962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:52.797093 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.797770 (+   677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.797771 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:52.797832 (+    61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.797835 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:52.797892 (+    57us) client_negotiation.cc:240] Negotiation successful
0928 13:06:52.797928 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480}
I20260928 13:06:52.797997 21635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.794663 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:42217 (local address 127.3.6.1:33025)
0928 13:06:52.794705 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.794708 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.795172 (+   464us) server_negotiation.cc:407] Connection header received
0928 13:06:52.795202 (+    30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.795203 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.795232 (+    29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.795295 (+    63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:52.795436 (+   141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.796060 (+   624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.797237 (+  1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.797667 (+   430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.797773 (+   106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.797784 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.797898 (+   114us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.797934 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:06:52.798345 21308 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9074f55c27bd43a7973add5a99347966" candidate_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65253fabbd764ec8a7cf540f0499a147"
I20260928 13:06:52.798363 21309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9074f55c27bd43a7973add5a99347966" candidate_uuid: "4ce4b8d9d84c4051a5576b3b5a961fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65253fabbd764ec8a7cf540f0499a147" is_pre_election: true
I20260928 13:06:52.798535 21309 raft_consensus.cc:2454] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ce4b8d9d84c4051a5576b3b5a961fb0 in term 0.
I20260928 13:06:52.807044 21636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.804565 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54606 (local address 127.3.6.2:44053)
0928 13:06:52.804604 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.804606 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.804681 (+    75us) server_negotiation.cc:407] Connection header received
0928 13:06:52.804744 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.804745 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.804760 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.804832 (+    72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:52.804934 (+   102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.805385 (+   451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.806256 (+   871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.806466 (+   210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.806542 (+    76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.806707 (+   165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:52.806800 (+    93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:52.806911 (+   111us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.806941 (+    30us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.806949 (+     8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:06:52.808584 21309 raft_consensus.cc:3037] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:52.808640 21577 raft_consensus.cc:1261] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 1 FOLLOWER]: Refusing update from remote peer 4ce4b8d9d84c4051a5576b3b5a961fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:52.808952 21646 consensus_queue.cc:1035] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1194b7ed8dab48d0807352344fda9051" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 43515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:52.809646 21309 raft_consensus.cc:1261] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 1 FOLLOWER]: Refusing update from remote peer 4ce4b8d9d84c4051a5576b3b5a961fb0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:52.809927 21646 consensus_queue.cc:1035] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65253fabbd764ec8a7cf540f0499a147" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 33025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:52.811357 21650 mvcc.cc:205] Tried to move back new op lower bound from 7334300929261916160 to 7334300929211002880. Current Snapshot: MvccSnapshot[applied={T|T < 7334300929261916160}]
I20260928 13:06:52.814270 21164 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:52.814352 21164 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:52.815109 21164 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 995710ca00eb438a8411106d8aa29a25: Sending DeleteTablet for 3 replicas of tablet 9074f55c27bd43a7973add5a99347966
I20260928 13:06:52.815434 21289 tablet_service.cc:1514] Processing DeleteTablet for tablet 9074f55c27bd43a7973add5a99347966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:49644
I20260928 13:06:52.815471 21423 tablet_service.cc:1514] Processing DeleteTablet for tablet 9074f55c27bd43a7973add5a99347966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:54604
I20260928 13:06:52.815666 21557 tablet_service.cc:1514] Processing DeleteTablet for tablet 9074f55c27bd43a7973add5a99347966 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:52 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:50656
I20260928 13:06:52.815943 21659 tablet_replica.cc:330] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147: stopping tablet replica
I20260928 13:06:52.815896 21661 tablet_replica.cc:330] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: stopping tablet replica
I20260928 13:06:52.816051 21659 raft_consensus.cc:2229] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:52.816147 21659 raft_consensus.cc:2258] T 9074f55c27bd43a7973add5a99347966 P 65253fabbd764ec8a7cf540f0499a147 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:52.816169  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21226
I20260928 13:06:52.816846 21660 tablet_replica.cc:330] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: stopping tablet replica
I20260928 13:06:52.817209 21660 raft_consensus.cc:2229] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:52.817332 21660 raft_consensus.cc:2258] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:52.818099 21660 ts_tablet_manager.cc:1905] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:52.819852 21660 ts_tablet_manager.cc:1918] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:52.819933 21660 log.cc:1196] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/9074f55c27bd43a7973add5a99347966
I20260928 13:06:52.820209 21660 ts_tablet_manager.cc:1939] T 9074f55c27bd43a7973add5a99347966 P 4ce4b8d9d84c4051a5576b3b5a961fb0: Deleting consensus metadata
I20260928 13:06:52.820631 21151 catalog_manager.cc:4841] TS 4ce4b8d9d84c4051a5576b3b5a961fb0 (127.3.6.2:44053): tablet 9074f55c27bd43a7973add5a99347966 (table test-table [id=e20c98fb3a444250a2abef96aa19d18e]) successfully deleted
W20260928 13:06:52.822528 21150 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:33025 (error 108)
I20260928 13:06:52.823002 21661 raft_consensus.cc:2229] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:52.823068 21633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.822902 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:33025 (local address 127.0.0.1:49648)
0928 13:06:52.822963 (+    61us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:52.823030 (+    67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:33025: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260928 13:06:52.823107  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21360
I20260928 13:06:52.823201 21661 raft_consensus.cc:2258] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:52.824468 21661 ts_tablet_manager.cc:1905] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 13:06:52.826140 21150 catalog_manager.cc:4584] TS 65253fabbd764ec8a7cf540f0499a147 (127.3.6.1:33025): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9074f55c27bd43a7973add5a99347966: Network error: Client connection negotiation failed: client connection to 127.3.6.1:33025: connect: Connection refused (error 111)
I20260928 13:06:52.826591 21661 ts_tablet_manager.cc:1918] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:52.826674 21661 log.cc:1196] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/9074f55c27bd43a7973add5a99347966
I20260928 13:06:52.826923 21661 ts_tablet_manager.cc:1939] T 9074f55c27bd43a7973add5a99347966 P 1194b7ed8dab48d0807352344fda9051: Deleting consensus metadata
I20260928 13:06:52.827441 21149 catalog_manager.cc:4841] TS 1194b7ed8dab48d0807352344fda9051 (127.3.6.3:43515): tablet 9074f55c27bd43a7973add5a99347966 (table test-table [id=e20c98fb3a444250a2abef96aa19d18e]) successfully deleted
I20260928 13:06:52.830096  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21494
I20260928 13:06:52.835436  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21132
2026-09-28T13:06:52Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1896 ms)
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-28T13:06:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:52Z Disabled control of system clock
I20260928 13:06:52.864053  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38245
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:38245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:52.944989 21666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:52.945204 21666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:52.945225 21666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:52.946429 21666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:52.946471 21666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:52.946488 21666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:52.946542 21666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:52.946566 21666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:52.947909 21666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:38245
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:52.948173 21666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:52.948487 21666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:52.953263 21672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.953248 21674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:52.953246 21671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:52.953613 21666 server_base.cc:1034] running on GCE node
I20260928 13:06:52.953802 21666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:52.954056 21666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:52.955192 21666 hybrid_clock.cc:648] HybridClock initialized: now 1790600812955176 us; error 32 us; skew 500 ppm
I20260928 13:06:52.956445 21666 webserver.cc:460] Webserver started at http://127.3.6.62:37789/ using document root <none> and password file <none>
I20260928 13:06:52.956682 21666 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:52.956728 21666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:52.956890 21666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:52.957984 21666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "f5c558a357cc4ed39c3c739f410249ba"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "14fcb5ae8315d809230a60528b76fc89"
server_key_iv: "75adb0e65c02eef7a833eac391c1b906"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.958349 21666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "f5c558a357cc4ed39c3c739f410249ba"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "14fcb5ae8315d809230a60528b76fc89"
server_key_iv: "75adb0e65c02eef7a833eac391c1b906"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.959663 21666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:06:52.960335 21680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:52.960515 21666 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:52.960608 21666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "f5c558a357cc4ed39c3c739f410249ba"
format_stamp: "Formatted at 2026-09-28 13:06:52 on dist-test-slave-ddvw"
server_key: "14fcb5ae8315d809230a60528b76fc89"
server_key_iv: "75adb0e65c02eef7a833eac391c1b906"
server_key_version: "encryptionkey@0"
I20260928 13:06:52.960685 21666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:52.979103 21666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:52.979414 21666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:52.979565 21666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:52.983537 21666 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:38245
I20260928 13:06:52.983569 21732 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:38245 every 8 connection(s)
I20260928 13:06:52.983925 21666 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:52.984905 21733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:52.987339 21733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: Bootstrap starting.
I20260928 13:06:52.987915 21733 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:52.988215 21733 log.cc:824] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:52.988518  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21666
I20260928 13:06:52.988637  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:52.988844  3096 external_mini_cluster.cc:1428] Setting key 3ed69f84a93ff22309204a78a15cd6a3
I20260928 13:06:52.989034 21733 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: No bootstrap required, opened a new log
I20260928 13:06:52.990842 21733 raft_consensus.cc:348] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } }
I20260928 13:06:52.991034 21733 raft_consensus.cc:374] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:52.991083 21733 raft_consensus.cc:729] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c558a357cc4ed39c3c739f410249ba, State: Initialized, Role: FOLLOWER
I20260928 13:06:52.991214 21733 consensus_queue.cc:260] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } }
I20260928 13:06:52.991305 21733 raft_consensus.cc:388] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:52.991338 21733 raft_consensus.cc:482] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:52.991390 21733 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:52.992211 21733 raft_consensus.cc:504] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } }
I20260928 13:06:52.992295 21733 leader_election.cc:302] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f5c558a357cc4ed39c3c739f410249ba; no voters: 
I20260928 13:06:52.992481 21733 leader_election.cc:288] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:52.992508 21738 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:52.992626 21738 raft_consensus.cc:686] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [term 1 LEADER]: Becoming Leader. State: Replica: f5c558a357cc4ed39c3c739f410249ba, State: Running, Role: LEADER
I20260928 13:06:52.992724 21733 sys_catalog.cc:564] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:52.992710 21738 consensus_queue.cc:237] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } }
I20260928 13:06:52.993064 21738 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader f5c558a357cc4ed39c3c739f410249ba. Latest consensus state: current_term: 1 leader_uuid: "f5c558a357cc4ed39c3c739f410249ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } } }
I20260928 13:06:52.993073 21740 sys_catalog.cc:455] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f5c558a357cc4ed39c3c739f410249ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f5c558a357cc4ed39c3c739f410249ba" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38245 } } }
I20260928 13:06:52.993155 21738 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:52.993172 21740 sys_catalog.cc:458] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:52.993660 21744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:52.994120 21744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:52.995889 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:52.989391 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.3.6.62:38245)
0928 13:06:52.989606 (+   215us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:52.989621 (+    15us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:52.989646 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:06:52.990823 (+  1177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:52.990829 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:52.990885 (+    56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:52.991001 (+   116us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:52.991310 (+   309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.992328 (+  1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.993416 (+  1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:52.994032 (+   616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:52.994145 (+   113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:52.995079 (+   934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:52.995083 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:52.995083 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:52.995283 (+   200us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:52.995323 (+    40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:52.995337 (+    14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:52.995405 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:52.995625 (+   220us) server_negotiation.cc:299] Negotiation successful
0928 13:06:52.995711 (+    86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":17,"server-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260928 13:06:52.996019 21744 catalog_manager.cc:1347] Generated new cluster ID: cab0000042234878a8cabd05b67ef521
I20260928 13:06:52.996069 21744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:53.012557 21744 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:53.013121 21744 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:53.020570 21744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: Generated new TSK 0
I20260928 13:06:53.020807 21744 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:06:53.023492  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--builtin_ntp_servers=127.3.6.20:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:53.105525 21757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:53.105717 21757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:53.105737 21757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:53.107048 21757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:53.107098 21757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:53.107124 21757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:53.108523 21757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:53.108764 21757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:53.109076 21757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:53.113897 21763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:53.113906 21762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:53.113941 21765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:53.114300 21757 server_base.cc:1034] running on GCE node
I20260928 13:06:53.114486 21757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:53.114724 21757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:53.115875 21757 hybrid_clock.cc:648] HybridClock initialized: now 1790600813115856 us; error 32 us; skew 500 ppm
I20260928 13:06:53.117187 21757 webserver.cc:460] Webserver started at http://127.3.6.1:43491/ using document root <none> and password file <none>
I20260928 13:06:53.117441 21757 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:53.117527 21757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:53.117681 21757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:53.118716 21757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "68c258e2063c4fbab797b3d87a1d941c"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "eb3e3ab7a1d7842c6be012f9a275fb7e"
server_key_iv: "a44ad2b39f2e883c8945463d22950980"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.119145 21757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "68c258e2063c4fbab797b3d87a1d941c"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "eb3e3ab7a1d7842c6be012f9a275fb7e"
server_key_iv: "a44ad2b39f2e883c8945463d22950980"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.120476 21757 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:53.121243 21771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.121423 21757 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:53.121521 21757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "68c258e2063c4fbab797b3d87a1d941c"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "eb3e3ab7a1d7842c6be012f9a275fb7e"
server_key_iv: "a44ad2b39f2e883c8945463d22950980"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.121610 21757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:53.132488 21757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:53.132797 21757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:53.132948 21757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:53.133176 21757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:53.133495 21757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:53.133550 21757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.133591 21757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:53.133618 21757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.139639 21757 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:37547
I20260928 13:06:53.139683 21884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:37547 every 8 connection(s)
I20260928 13:06:53.140026 21757 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:53.145484 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.140779 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:55737 (local address 127.3.6.62:38245)
0928 13:06:53.140833 (+    54us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.140835 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.141086 (+   251us) server_negotiation.cc:407] Connection header received
0928 13:06:53.141640 (+   554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.141641 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.141658 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.141723 (+    65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:53.142435 (+   712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.142934 (+   499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.144010 (+  1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.144213 (+   203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.144306 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.145170 (+   864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:53.145171 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:53.145171 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:53.145177 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:53.145193 (+    16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:53.145197 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:53.145265 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.145367 (+   102us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.145400 (+    33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:06:53.145745 21887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.140762 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38245 (local address 127.3.6.1:55737)
0928 13:06:53.140950 (+   188us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.140985 (+    35us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.141529 (+   544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.141797 (+   268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.141801 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.141811 (+    10us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:53.142329 (+   518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.142333 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.143079 (+   746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.143080 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.143893 (+   813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.143895 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.144319 (+   424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.144333 (+    14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.144468 (+   135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.145019 (+   551us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:53.145020 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:53.145048 (+    28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:53.145073 (+    25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:53.145266 (+   193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:53.145272 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:53.145276 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.145357 (+    81us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.145463 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":72,"threads_started":1}
I20260928 13:06:53.146347 21885 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38245
I20260928 13:06:53.146486 21885 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:53.146668 21885 heartbeater.cc:511] Master 127.3.6.62:38245 requested a full tablet report, sending...
I20260928 13:06:53.147234 21697 ts_manager.cc:194] Registered new tserver with Master: 68c258e2063c4fbab797b3d87a1d941c (127.3.6.1:37547)
I20260928 13:06:53.148029 21697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.1:55737
I20260928 13:06:53.149053  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21757
I20260928 13:06:53.149161  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:06:53.149362  3096 external_mini_cluster.cc:1428] Setting key c114109d8bfdae0641ca38d3885fd154
I20260928 13:06:53.150271  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--builtin_ntp_servers=127.3.6.20:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:53.230664 21888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:53.230862 21888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:53.230882 21888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:53.231992 21888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:53.232026 21888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:53.232050 21888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:53.233299 21888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:53.233493 21888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:53.233728 21888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:53.238654 21893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:53.238648 21896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:53.238708 21888 server_base.cc:1034] running on GCE node
W20260928 13:06:53.238648 21894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:53.239094 21888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:53.239312 21888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:53.240456 21888 hybrid_clock.cc:648] HybridClock initialized: now 1790600813240429 us; error 43 us; skew 500 ppm
I20260928 13:06:53.241639 21888 webserver.cc:460] Webserver started at http://127.3.6.2:33823/ using document root <none> and password file <none>
I20260928 13:06:53.241822 21888 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:53.241863 21888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:53.241974 21888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:53.242942 21888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "e27ac54cbe47447aac8f7481796956b5"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "379e3e700d9efe4b2b927dc5b650c713"
server_key_iv: "59bc86785829d58f965ccca8f289685b"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.243319 21888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "e27ac54cbe47447aac8f7481796956b5"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "379e3e700d9efe4b2b927dc5b650c713"
server_key_iv: "59bc86785829d58f965ccca8f289685b"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.244514 21888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:53.245138 21902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.245288 21888 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:53.245354 21888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "e27ac54cbe47447aac8f7481796956b5"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "379e3e700d9efe4b2b927dc5b650c713"
server_key_iv: "59bc86785829d58f965ccca8f289685b"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.245404 21888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:53.269749 21888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:53.270047 21888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:53.270151 21888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:53.270347 21888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:53.270627 21888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:53.270655 21888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.270677 21888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:53.270689 21888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.276399 21888 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:35909
I20260928 13:06:53.276513 22015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:35909 every 8 connection(s)
I20260928 13:06:53.276724 21888 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:53.281605 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.277426 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55679 (local address 127.3.6.62:38245)
0928 13:06:53.277497 (+    71us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.277498 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.277700 (+   202us) server_negotiation.cc:407] Connection header received
0928 13:06:53.278196 (+   496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.278196 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.278206 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.278259 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:53.278884 (+   625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.279455 (+   571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.280395 (+   940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.280589 (+   194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.280641 (+    52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.281374 (+   733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:53.281375 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:53.281375 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:53.281379 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:53.281392 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:53.281395 (+     3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:53.281450 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.281521 (+    71us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.281544 (+    23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:06:53.281787 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.277404 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38245 (local address 127.3.6.2:55679)
0928 13:06:53.277595 (+   191us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.277628 (+    33us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.278107 (+   479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.278315 (+   208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.278318 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.278326 (+     8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:53.278811 (+   485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.278815 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.279531 (+   716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.279531 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.280319 (+   788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.280321 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.280649 (+   328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.280658 (+     9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.280763 (+   105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.281249 (+   486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:53.281249 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:53.281276 (+    27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:53.281297 (+    21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:53.281453 (+   156us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:53.281457 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:53.281459 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.281512 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.281589 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260928 13:06:53.282261 22016 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38245
I20260928 13:06:53.282368 22016 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:53.282545 22016 heartbeater.cc:511] Master 127.3.6.62:38245 requested a full tablet report, sending...
I20260928 13:06:53.283037 21697 ts_manager.cc:194] Registered new tserver with Master: e27ac54cbe47447aac8f7481796956b5 (127.3.6.2:35909)
I20260928 13:06:53.283366 21697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.2:55679
I20260928 13:06:53.285101  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 21888
I20260928 13:06:53.285197  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:53.285395  3096 external_mini_cluster.cc:1428] Setting key 1db4145a27b4d46101b857ef9c7aed39
I20260928 13:06:53.286286  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--builtin_ntp_servers=127.3.6.20:37193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:53.368069 22019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:53.368356 22019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:53.368408 22019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:53.369576 22019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:53.369640 22019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:53.369683 22019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:53.371001 22019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38245
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:53.371281 22019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:53.371577 22019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:53.376508 22025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:53.376485 22024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:53.376497 22027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:53.376560 22019 server_base.cc:1034] running on GCE node
I20260928 13:06:53.376930 22019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:53.377172 22019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:53.378333 22019 hybrid_clock.cc:648] HybridClock initialized: now 1790600813378330 us; error 38 us; skew 500 ppm
I20260928 13:06:53.379577 22019 webserver.cc:460] Webserver started at http://127.3.6.3:42687/ using document root <none> and password file <none>
I20260928 13:06:53.379817 22019 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:53.379885 22019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:53.380024 22019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:53.381059 22019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "2f61a330f02540498aa169352c43e3f3"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "02500fa9d0efc2f472896f2757b479e7"
server_key_iv: "4d8e253532618de4207ee7f62205be68"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.381443 22019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "2f61a330f02540498aa169352c43e3f3"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "02500fa9d0efc2f472896f2757b479e7"
server_key_iv: "4d8e253532618de4207ee7f62205be68"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.382725 22019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:06:53.383569 22033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.383751 22019 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.000s
I20260928 13:06:53.383848 22019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "2f61a330f02540498aa169352c43e3f3"
format_stamp: "Formatted at 2026-09-28 13:06:53 on dist-test-slave-ddvw"
server_key: "02500fa9d0efc2f472896f2757b479e7"
server_key_iv: "4d8e253532618de4207ee7f62205be68"
server_key_version: "encryptionkey@0"
I20260928 13:06:53.383934 22019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:53.395437 22019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:53.395730 22019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:53.395885 22019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:53.396112 22019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:53.396474 22019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:53.396530 22019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.396564 22019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:53.396590 22019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:53.402416 22019 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:33059
I20260928 13:06:53.402464 22146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:33059 every 8 connection(s)
I20260928 13:06:53.402776 22019 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:53.408192 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.403484 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:60201 (local address 127.3.6.62:38245)
0928 13:06:53.403528 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.403530 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.403792 (+   262us) server_negotiation.cc:407] Connection header received
0928 13:06:53.404318 (+   526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.404319 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.404335 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.404432 (+    97us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:53.405085 (+   653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.405587 (+   502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.406589 (+  1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.406781 (+   192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.406863 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.407895 (+  1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:53.407896 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:53.407897 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:53.407901 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:53.407918 (+    17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:53.407923 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:53.407977 (+    54us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.408079 (+   102us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.408111 (+    32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:06:53.408432 22149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.403486 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38245 (local address 127.3.6.3:60201)
0928 13:06:53.403676 (+   190us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.403708 (+    32us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.404212 (+   504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.404471 (+   259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.404475 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.404486 (+    11us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:53.404988 (+   502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.404992 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.405684 (+   692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.405685 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.406483 (+   798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.406486 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.406864 (+   378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.406877 (+    13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.407053 (+   176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.407753 (+   700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:53.407754 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:53.407782 (+    28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:53.407805 (+    23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:53.407984 (+   179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:53.407989 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:53.407992 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.408080 (+    88us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.408183 (+   103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260928 13:06:53.408946 22147 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38245
I20260928 13:06:53.409047 22147 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:53.409220 22147 heartbeater.cc:511] Master 127.3.6.62:38245 requested a full tablet report, sending...
I20260928 13:06:53.409628 21697 ts_manager.cc:194] Registered new tserver with Master: 2f61a330f02540498aa169352c43e3f3 (127.3.6.3:33059)
I20260928 13:06:53.410018 21697 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.3:60201
I20260928 13:06:53.411077  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22019
I20260928 13:06:53.411175  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:53.411347  3096 external_mini_cluster.cc:1428] Setting key 287a2583fac5e8de58a3450d7d9e53cd
I20260928 13:06:53.412240  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:53.416389 21737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.413528 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.3.6.62:38245)
0928 13:06:53.413604 (+    76us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.413606 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.413674 (+    68us) server_negotiation.cc:407] Connection header received
0928 13:06:53.413710 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.413711 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.413719 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.413766 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:53.413938 (+   172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.414390 (+   452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.415257 (+   867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.415447 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.415497 (+    50us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.416108 (+   611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:53.416109 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:53.416110 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:53.416113 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:53.416126 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:53.416129 (+     3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:53.416201 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.416262 (+    61us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.416272 (+    10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 13:06:53.417950 21697 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55438:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:53.419660 21697 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:53.426002 22159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.422085 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33350 (local address 127.3.6.2:35909)
0928 13:06:53.422266 (+   181us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.422269 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.422278 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:06:53.422313 (+    35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.422314 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.422328 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.422434 (+   106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:53.422644 (+   210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.423870 (+  1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425086 (+  1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.425584 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425683 (+    99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.425777 (+    94us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.425867 (+    90us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.425914 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":78,"threads_started":1}
I20260928 13:06:53.426005 22157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.421781 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37547 (local address 127.0.0.1:37164)
0928 13:06:53.422076 (+   295us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.422087 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.422138 (+    51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.422481 (+   343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.422482 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.422485 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:53.422565 (+    80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.422567 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.423600 (+  1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.423601 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.424865 (+  1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.424867 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.425706 (+   839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425707 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.425771 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.425790 (+    19us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.425843 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.425895 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":2,"spinlock_wait_cycles":768,"thread_start_us":101,"threads_started":1}
I20260928 13:06:53.426263 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.422051 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37164 (local address 127.3.6.1:37547)
0928 13:06:53.422238 (+   187us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.422243 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.422254 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:53.422296 (+    42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.422298 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.422314 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.422406 (+    92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:53.422647 (+   241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.423502 (+   855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.424962 (+  1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.425612 (+   650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425694 (+    82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.425778 (+    84us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.426132 (+   354us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.426180 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260928 13:06:53.426007 22155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.421782 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:35909 (local address 127.0.0.1:33350)
0928 13:06:53.421928 (+   146us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.421972 (+    44us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.422042 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.422465 (+   423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.422468 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.422470 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:53.422541 (+    71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.422544 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.423958 (+  1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.423960 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.424999 (+  1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.425001 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.425687 (+   686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425688 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.425765 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.425778 (+    13us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.425853 (+    75us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.425899 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":95,"threads_started":1}
I20260928 13:06:53.426966 22156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.421797 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:33059 (local address 127.0.0.1:49092)
0928 13:06:53.422220 (+   423us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.422230 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.422266 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.422664 (+   398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.422664 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.422666 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:53.422702 (+    36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.422703 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.424057 (+  1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.424058 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.425075 (+  1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.425078 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.426745 (+  1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.426745 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.426808 (+    63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.426811 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.426854 (+    43us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.426896 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":408,"thread_start_us":109,"threads_started":1}
I20260928 13:06:53.426970 21819 tablet_service.cc:1467] Processing CreateTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 (DEFAULT_TABLE table=test-table [id=24d85f73851f4666b9481692747c987b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:53.427054 21950 tablet_service.cc:1467] Processing CreateTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 (DEFAULT_TABLE table=test-table [id=24d85f73851f4666b9481692747c987b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:53.427325 22160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.422257 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49092 (local address 127.3.6.3:33059)
0928 13:06:53.422428 (+   171us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.422433 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.422443 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:53.422546 (+   103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.422548 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.422566 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.422769 (+   203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:53.422827 (+    58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.423992 (+  1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.425816 (+  1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.426641 (+   825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.426739 (+    98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.427214 (+   475us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.427235 (+    21us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.427265 (+    30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
I20260928 13:06:53.427362 21950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75eb6cd21d184ce592b3d8ec1565bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:53.427362 21819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75eb6cd21d184ce592b3d8ec1565bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:53.430166 22081 tablet_service.cc:1467] Processing CreateTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 (DEFAULT_TABLE table=test-table [id=24d85f73851f4666b9481692747c987b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:53.430430 22081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75eb6cd21d184ce592b3d8ec1565bab7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:53.430783 22161 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: Bootstrap starting.
I20260928 13:06:53.431182 22162 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Bootstrap starting.
I20260928 13:06:53.431492 22161 tablet_bootstrap.cc:654] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:53.431656 22162 tablet_bootstrap.cc:654] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:53.431830 22161 log.cc:824] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:53.431870 22162 log.cc:824] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:53.432576 22162 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: No bootstrap required, opened a new log
I20260928 13:06:53.432624 22162 ts_tablet_manager.cc:1397] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Time spent bootstrapping tablet: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:53.432799 22161 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: No bootstrap required, opened a new log
I20260928 13:06:53.432858 22161 ts_tablet_manager.cc:1397] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:53.433805 22165 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Bootstrap starting.
I20260928 13:06:53.434448 22165 tablet_bootstrap.cc:654] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:53.434778 22165 log.cc:824] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:53.434917 22162 raft_consensus.cc:348] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.435284 22162 raft_consensus.cc:374] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:53.435336 22162 raft_consensus.cc:729] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27ac54cbe47447aac8f7481796956b5, State: Initialized, Role: FOLLOWER
I20260928 13:06:53.435484 22162 consensus_queue.cc:260] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.435581 22165 tablet_bootstrap.cc:492] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: No bootstrap required, opened a new log
I20260928 13:06:53.435653 22165 ts_tablet_manager.cc:1397] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:53.435750 22162 ts_tablet_manager.cc:1428] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:53.435657 22161 raft_consensus.cc:348] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.435813 22161 raft_consensus.cc:374] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:53.435856 22161 raft_consensus.cc:729] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68c258e2063c4fbab797b3d87a1d941c, State: Initialized, Role: FOLLOWER
I20260928 13:06:53.435894 22016 heartbeater.cc:503] Master 127.3.6.62:38245 was elected leader, sending a full tablet report...
I20260928 13:06:53.435979 22161 consensus_queue.cc:260] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.436254 22161 ts_tablet_manager.cc:1428] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:53.436290 21885 heartbeater.cc:503] Master 127.3.6.62:38245 was elected leader, sending a full tablet report...
I20260928 13:06:53.438426 22165 raft_consensus.cc:348] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.438551 22165 raft_consensus.cc:374] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:53.438573 22165 raft_consensus.cc:729] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f61a330f02540498aa169352c43e3f3, State: Initialized, Role: FOLLOWER
I20260928 13:06:53.438684 22165 consensus_queue.cc:260] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.438959 22165 ts_tablet_manager.cc:1428] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:53.438977 22147 heartbeater.cc:503] Master 127.3.6.62:38245 was elected leader, sending a full tablet report...
I20260928 13:06:53.515942 22167 raft_consensus.cc:482] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:53.516112 22167 raft_consensus.cc:504] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.516485 22167 leader_election.cc:288] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 68c258e2063c4fbab797b3d87a1d941c (127.3.6.1:37547), 2f61a330f02540498aa169352c43e3f3 (127.3.6.3:33059)
I20260928 13:06:53.520601 22160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.516777 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:34185 (local address 127.3.6.3:33059)
0928 13:06:53.516820 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.516822 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.516831 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:06:53.516870 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.516871 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.516878 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.516974 (+    96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:53.517176 (+   202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.517950 (+   774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.519635 (+  1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.520209 (+   574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.520294 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.520305 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.520484 (+   179us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.520530 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:06:53.520601 22158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.516765 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:56823 (local address 127.3.6.1:37547)
0928 13:06:53.516813 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.516815 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.516958 (+   143us) server_negotiation.cc:407] Connection header received
0928 13:06:53.516987 (+    29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.516988 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.517001 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.517057 (+    56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:53.517227 (+   170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.517950 (+   723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.519636 (+  1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.520209 (+   573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.520294 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.520318 (+    24us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.520497 (+   179us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.520534 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:06:53.520601 22018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.516685 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:33059 (local address 127.3.6.2:34185)
0928 13:06:53.516744 (+    59us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.516756 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.516803 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.516991 (+   188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.516991 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.516993 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:53.517089 (+    96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.517091 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.518043 (+   952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.518044 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.519499 (+  1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.519503 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.520310 (+   807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.520311 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.520386 (+    75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.520390 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.520451 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.520502 (+    51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":113}
I20260928 13:06:53.520608 22170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.516685 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37547 (local address 127.3.6.2:56823)
0928 13:06:53.516861 (+   176us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.516870 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:53.516923 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:53.517073 (+   150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:53.517074 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:53.517075 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:53.517130 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.517131 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.518043 (+   912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.518044 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.519499 (+  1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:53.519503 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.520310 (+   807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.520311 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:53.520424 (+   113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.520428 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:53.520481 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:06:53.520509 (+    28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":85,"thread_start_us":98,"threads_started":1}
I20260928 13:06:53.521000 22101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75eb6cd21d184ce592b3d8ec1565bab7" candidate_uuid: "e27ac54cbe47447aac8f7481796956b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f61a330f02540498aa169352c43e3f3" is_pre_election: true
I20260928 13:06:53.521149 21839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75eb6cd21d184ce592b3d8ec1565bab7" candidate_uuid: "e27ac54cbe47447aac8f7481796956b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68c258e2063c4fbab797b3d87a1d941c" is_pre_election: true
I20260928 13:06:53.521191 22101 raft_consensus.cc:2454] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27ac54cbe47447aac8f7481796956b5 in term 0.
I20260928 13:06:53.521281 21839 raft_consensus.cc:2454] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e27ac54cbe47447aac8f7481796956b5 in term 0.
I20260928 13:06:53.521459 21904 leader_election.cc:302] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f61a330f02540498aa169352c43e3f3, e27ac54cbe47447aac8f7481796956b5; no voters: 
I20260928 13:06:53.521631 22167 raft_consensus.cc:2781] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:53.521692 22167 raft_consensus.cc:482] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:53.521713 22167 raft_consensus.cc:3037] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:53.522431 22167 raft_consensus.cc:504] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.522583 22167 leader_election.cc:288] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [CANDIDATE]: Term 1 election: Requested vote from peers 68c258e2063c4fbab797b3d87a1d941c (127.3.6.1:37547), 2f61a330f02540498aa169352c43e3f3 (127.3.6.3:33059)
I20260928 13:06:53.522729 22101 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75eb6cd21d184ce592b3d8ec1565bab7" candidate_uuid: "e27ac54cbe47447aac8f7481796956b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f61a330f02540498aa169352c43e3f3"
I20260928 13:06:53.522729 21839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75eb6cd21d184ce592b3d8ec1565bab7" candidate_uuid: "e27ac54cbe47447aac8f7481796956b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68c258e2063c4fbab797b3d87a1d941c"
I20260928 13:06:53.522815 22101 raft_consensus.cc:3037] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:53.522809 21839 raft_consensus.cc:3037] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:53.523767 21839 raft_consensus.cc:2454] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27ac54cbe47447aac8f7481796956b5 in term 1.
I20260928 13:06:53.523762 22101 raft_consensus.cc:2454] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e27ac54cbe47447aac8f7481796956b5 in term 1.
I20260928 13:06:53.523949 21904 leader_election.cc:302] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f61a330f02540498aa169352c43e3f3, e27ac54cbe47447aac8f7481796956b5; no voters: 
I20260928 13:06:53.524082 22167 raft_consensus.cc:2781] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:53.524300 22167 raft_consensus.cc:686] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 1 LEADER]: Becoming Leader. State: Replica: e27ac54cbe47447aac8f7481796956b5, State: Running, Role: LEADER
I20260928 13:06:53.524412 22167 consensus_queue.cc:237] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } }
I20260928 13:06:53.525352 21696 catalog_manager.cc:5495] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to e27ac54cbe47447aac8f7481796956b5 (127.3.6.2). New cstate: current_term: 1 leader_uuid: "e27ac54cbe47447aac8f7481796956b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27ac54cbe47447aac8f7481796956b5" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 } health_report { overall_health: UNKNOWN } } }
W20260928 13:06:53.527124 22017 tablet.cc:2369] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:06:53.546481 22159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.543957 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.3.6.2:35909)
0928 13:06:53.544028 (+    71us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:53.544031 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:53.544042 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:06:53.544122 (+    80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:53.544123 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:53.544147 (+    24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:53.544235 (+    88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:53.544374 (+   139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.544866 (+   492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.545651 (+   785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:53.545857 (+   206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:53.545936 (+    79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:53.546089 (+   153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:53.546187 (+    98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:53.546295 (+   108us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:53.546349 (+    54us) server_negotiation.cc:299] Negotiation successful
0928 13:06:53.546360 (+    11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 13:06:53.548482 21839 raft_consensus.cc:1261] T 75eb6cd21d184ce592b3d8ec1565bab7 P 68c258e2063c4fbab797b3d87a1d941c [term 1 FOLLOWER]: Refusing update from remote peer e27ac54cbe47447aac8f7481796956b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:53.548506 22101 raft_consensus.cc:1261] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 1 FOLLOWER]: Refusing update from remote peer e27ac54cbe47447aac8f7481796956b5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:53.548826 22167 consensus_queue.cc:1035] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68c258e2063c4fbab797b3d87a1d941c" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 37547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:53.549001 22171 consensus_queue.cc:1035] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f61a330f02540498aa169352c43e3f3" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 33059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:53.551189 22174 mvcc.cc:205] Tried to move back new op lower bound from 7334300932291710976 to 7334300932196864000. Current Snapshot: MvccSnapshot[applied={T|T < 7334300932291710976}]
I20260928 13:06:53.551801 22176 mvcc.cc:205] Tried to move back new op lower bound from 7334300932291710976 to 7334300932196864000. Current Snapshot: MvccSnapshot[applied={T|T < 7334300932291710976}]
I20260928 13:06:53.552265 22175 mvcc.cc:205] Tried to move back new op lower bound from 7334300932291710976 to 7334300932196864000. Current Snapshot: MvccSnapshot[applied={T|T < 7334300932291710976 or (T in {7334300932291710976})}]
I20260928 13:06:53.553689 21696 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:53.553792 21696 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:53.554507 21696 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f5c558a357cc4ed39c3c739f410249ba: Sending DeleteTablet for 3 replicas of tablet 75eb6cd21d184ce592b3d8ec1565bab7
I20260928 13:06:53.554844 21950 tablet_service.cc:1514] Processing DeleteTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:53 UTC) from {username='slave'} at 127.0.0.1:33350
I20260928 13:06:53.554843 21819 tablet_service.cc:1514] Processing DeleteTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:53 UTC) from {username='slave'} at 127.0.0.1:37164
I20260928 13:06:53.554881 22081 tablet_service.cc:1514] Processing DeleteTablet for tablet 75eb6cd21d184ce592b3d8ec1565bab7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:53 UTC) from {username='slave'} at 127.0.0.1:49092
I20260928 13:06:53.555189 22186 tablet_replica.cc:330] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: stopping tablet replica
I20260928 13:06:53.555433  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21757
I20260928 13:06:53.559283 22186 raft_consensus.cc:2229] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:53.559441 22186 raft_consensus.cc:2258] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:53.559993 22186 ts_tablet_manager.cc:1905] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:53.561748 22186 ts_tablet_manager.cc:1918] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:53.561838 22186 log.cc:1196] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/75eb6cd21d184ce592b3d8ec1565bab7
I20260928 13:06:53.562079 22186 ts_tablet_manager.cc:1939] T 75eb6cd21d184ce592b3d8ec1565bab7 P 2f61a330f02540498aa169352c43e3f3: Deleting consensus metadata
I20260928 13:06:53.562561 21682 catalog_manager.cc:4841] TS 2f61a330f02540498aa169352c43e3f3 (127.3.6.3:33059): tablet 75eb6cd21d184ce592b3d8ec1565bab7 (table test-table [id=24d85f73851f4666b9481692747c987b]) successfully deleted
I20260928 13:06:53.563174 22184 tablet_replica.cc:330] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: stopping tablet replica
I20260928 13:06:53.563310 22184 raft_consensus.cc:2229] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:53.563432 22184 raft_consensus.cc:2258] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 13:06:53.563797 21684 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:37547 (error 108)
I20260928 13:06:53.563934 22184 ts_tablet_manager.cc:1905] T 75eb6cd21d184ce592b3d8ec1565bab7 P e27ac54cbe47447aac8f7481796956b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:53.564376 22155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.564228 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:37547 (local address 127.0.0.1:37180)
0928 13:06:53.564293 (+    65us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.564340 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37547: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260928 13:06:53.564492 21684 catalog_manager.cc:4584] TS 68c258e2063c4fbab797b3d87a1d941c (127.3.6.1:37547): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 75eb6cd21d184ce592b3d8ec1565bab7: Network error: Client connection negotiation failed: client connection to 127.3.6.1:37547: connect: Connection refused (error 111)
I20260928 13:06:53.564692  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21888
I20260928 13:06:53.570225  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22019
I20260928 13:06:53.570353 22155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:53.570197 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:35909 (local address 127.0.0.1:33360)
0928 13:06:53.570262 (+    65us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:53.570305 (+    43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.2:35909: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260928 13:06:53.574985  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 21666
2026-09-28T13:06:53Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (737 ms)
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:53 dist-test-slave-ddvw krb5kdc[22190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:53 dist-test-slave-ddvw krb5kdc[22190](info): set up 2 sockets
Sep 28 13:06:53 dist-test-slave-ddvw krb5kdc[22190](info): commencing operation
krb5kdc: starting...
W20260928 13:06:54.602994  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.009s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:54 dist-test-slave-ddvw krb5kdc[22190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:06:54.726383  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38523
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:38523
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:54.811909 22203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:54.812143 22203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:54.812170 22203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:54.813395 22203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:54.813436 22203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:54.813452 22203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:54.813467 22203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:54.813479 22203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:54.815085 22203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:38523
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:38523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:54.815302 22203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:54.815497 22203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:54.820515 22208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:54.820526 22211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:54.820516 22209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:54.820890 22203 server_base.cc:1034] running on GCE node
I20260928 13:06:54.821201 22203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:54.821499 22203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:54.822659 22203 hybrid_clock.cc:648] HybridClock initialized: now 1790600814822641 us; error 30 us; skew 500 ppm
Sep 28 13:06:54 dist-test-slave-ddvw krb5kdc[22190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600814, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:54.825609 22203 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:06:54.826152 22203 webserver.cc:460] Webserver started at http://127.3.6.62:44013/ using document root <none> and password file <none>
I20260928 13:06:54.826360 22203 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:54.826404 22203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:54.826515 22203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:54.827726 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "eba146222517421abe14144bf9799220"
format_stamp: "Formatted at 2026-09-28 13:06:54 on dist-test-slave-ddvw"
server_key: "4fd603c3ed2159fea65a9b84df49333a"
server_key_iv: "19ba2ba67d5f0812713e720da5ade09d"
server_key_version: "encryptionkey@0"
I20260928 13:06:54.828064 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "eba146222517421abe14144bf9799220"
format_stamp: "Formatted at 2026-09-28 13:06:54 on dist-test-slave-ddvw"
server_key: "4fd603c3ed2159fea65a9b84df49333a"
server_key_iv: "19ba2ba67d5f0812713e720da5ade09d"
server_key_version: "encryptionkey@0"
I20260928 13:06:54.829533 22203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:06:54.830403 22218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:54.830611 22203 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:54.830751 22203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "eba146222517421abe14144bf9799220"
format_stamp: "Formatted at 2026-09-28 13:06:54 on dist-test-slave-ddvw"
server_key: "4fd603c3ed2159fea65a9b84df49333a"
server_key_iv: "19ba2ba67d5f0812713e720da5ade09d"
server_key_version: "encryptionkey@0"
I20260928 13:06:54.830844 22203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:54.845028 22203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:54.847832 22203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:54.848027 22203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:54.852761 22203 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:38523
I20260928 13:06:54.852818 22270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:38523 every 8 connection(s)
I20260928 13:06:54.853245 22203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:54.854141 22271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:54.856406 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: Bootstrap starting.
I20260928 13:06:54.856961 22271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:54.857194 22271 log.cc:824] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:54.857880 22271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: No bootstrap required, opened a new log
I20260928 13:06:54.859543 22271 raft_consensus.cc:348] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } }
I20260928 13:06:54.859684 22271 raft_consensus.cc:374] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:54.859707 22271 raft_consensus.cc:729] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba146222517421abe14144bf9799220, State: Initialized, Role: FOLLOWER
I20260928 13:06:54.859820 22271 consensus_queue.cc:260] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } }
I20260928 13:06:54.859875 22271 raft_consensus.cc:388] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:54.859896 22271 raft_consensus.cc:482] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:54.859969 22271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:54.860558 22271 raft_consensus.cc:504] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } }
I20260928 13:06:54.860644 22271 leader_election.cc:302] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eba146222517421abe14144bf9799220; no voters: 
I20260928 13:06:54.860832 22271 leader_election.cc:288] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:54.860903 22274 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:54.861114 22271 sys_catalog.cc:564] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:54.861135 22274 raft_consensus.cc:686] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [term 1 LEADER]: Becoming Leader. State: Replica: eba146222517421abe14144bf9799220, State: Running, Role: LEADER
I20260928 13:06:54.861218 22274 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } }
I20260928 13:06:54.861676 22276 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba146222517421abe14144bf9799220. Latest consensus state: current_term: 1 leader_uuid: "eba146222517421abe14144bf9799220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } } }
I20260928 13:06:54.861761 22276 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:54.861755  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22203
I20260928 13:06:54.861864  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:54.861850 22275 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eba146222517421abe14144bf9799220" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba146222517421abe14144bf9799220" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 38523 } } }
I20260928 13:06:54.861937 22275 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:54.862079  3096 external_mini_cluster.cc:1428] Setting key 65fc29e9c70b73d48c70b1aef5631910
I20260928 13:06:54.862740 22283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:54.863337 22283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:54.866034 22283 catalog_manager.cc:1347] Generated new cluster ID: 43b2dc17091c48a983202406501511de
I20260928 13:06:54.866113 22283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:06:54 dist-test-slave-ddvw krb5kdc[22190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600814, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:54.875408 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:54.862602 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55164 (local address 127.3.6.62:38523)
0928 13:06:54.862773 (+   171us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:54.862784 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:54.862836 (+    52us) server_negotiation.cc:407] Connection header received
0928 13:06:54.862962 (+   126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:54.862970 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:54.863054 (+    84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:54.864086 (+  1032us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:54.864187 (+   101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:54.865537 (+  1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:54.867715 (+  2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:54.868393 (+   678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:54.868506 (+   113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:54.871461 (+  2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:54.871467 (+     6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:54.871468 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:54.871482 (+    14us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:54.873615 (+  2133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:54.874017 (+   402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:54.874021 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:54.874021 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:54.874159 (+   138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:54.874370 (+   211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:54.874371 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:54.874371 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:54.874724 (+   353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:54.874889 (+   165us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:54.874980 (+    91us) server_negotiation.cc:299] Negotiation successful
0928 13:06:54.875158 (+   178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260928 13:06:54.884606 22283 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:54.885149 22283 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:54.889878 22283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: Generated new TSK 0
I20260928 13:06:54.890053 22283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.3.6.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
Entry for principal kudu/127.3.6.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab.
I20260928 13:06:54.917783  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:55.009483 22297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.009698 22297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.009723 22297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.011191 22297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.011237 22297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.011268 22297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:55.012979 22297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.1.keytab
--principal=kudu/127.3.6.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.013275 22297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.013536 22297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.019088 22302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.019078 22303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.019122 22297 server_base.cc:1034] running on GCE node
W20260928 13:06:55.019078 22305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.019505 22297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.019726 22297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.020866 22297 hybrid_clock.cc:648] HybridClock initialized: now 1790600815020851 us; error 27 us; skew 500 ppm
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:55.023451 22297 init.cc:377] Logged in from keytab as kudu/127.3.6.1@KRBTEST.COM (short username kudu)
I20260928 13:06:55.023835 22297 webserver.cc:460] Webserver started at http://127.3.6.1:35731/ using document root <none> and password file <none>
I20260928 13:06:55.024066 22297 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.024133 22297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.024296 22297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.025352 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "2209a4dc25664f44964509eb1fc35a75"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "0297ce14ec1a4e1ed428b8a466016b4b"
server_key_iv: "f71c814a652df5d57545ed7efea2d6da"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.025708 22297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "2209a4dc25664f44964509eb1fc35a75"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "0297ce14ec1a4e1ed428b8a466016b4b"
server_key_iv: "f71c814a652df5d57545ed7efea2d6da"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.027130 22297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.001s
I20260928 13:06:55.027912 22312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.028088 22297 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:55.028195 22297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "2209a4dc25664f44964509eb1fc35a75"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "0297ce14ec1a4e1ed428b8a466016b4b"
server_key_iv: "f71c814a652df5d57545ed7efea2d6da"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.028278 22297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.035466 22297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.037264 22297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.037424 22297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.037643 22297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:55.037925 22297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:55.037977 22297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.038017 22297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:55.038044 22297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.043745 22297 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:41641
I20260928 13:06:55.043819 22425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:41641 every 8 connection(s)
I20260928 13:06:55.044124 22297 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.1@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:55.053174  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22297
I20260928 13:06:55.053249 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.044873 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:43473 (local address 127.3.6.62:38523)
0928 13:06:55.044940 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.044942 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.045104 (+   162us) server_negotiation.cc:407] Connection header received
0928 13:06:55.045594 (+   490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.045595 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.045605 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.045666 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.046588 (+   922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.047180 (+   592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.048119 (+   939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.048344 (+   225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.048397 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.050457 (+  2060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.050458 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.050459 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:55.050465 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.051985 (+  1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.052352 (+   367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.052353 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.052353 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.052401 (+    48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.052606 (+   205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.052607 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.052607 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.052706 (+    99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.052758 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.053038 (+   280us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.053136 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 13:06:55.053282  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:06:55.053285 22428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.044827 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38523 (local address 127.3.6.1:43473)
0928 13:06:55.044984 (+   157us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.045025 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.045484 (+   459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.045745 (+   261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.045748 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.046320 (+   572us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:55.046502 (+   182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.046507 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.047255 (+   748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.047256 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.048045 (+   789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.048047 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.048424 (+   377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.048434 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.048534 (+   100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.048983 (+   449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:55.048990 (+     7us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:55.050374 (+  1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:55.052053 (+  1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.052059 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.052060 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.052266 (+   206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.052459 (+   193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.052460 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.052460 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.052552 (+    92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.052761 (+   209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:55.052765 (+     4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:55.052901 (+   136us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.052981 (+    80us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.053095 (+   114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260928 13:06:55.053472  3096 external_mini_cluster.cc:1428] Setting key 28bde43ec6306434fe02928e4c2b4161
I20260928 13:06:55.053839 22426 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38523
I20260928 13:06:55.053944 22426 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:55.054162 22426 heartbeater.cc:511] Master 127.3.6.62:38523 requested a full tablet report, sending...
I20260928 13:06:55.054713 22235 ts_manager.cc:194] Registered new tserver with Master: 2209a4dc25664f44964509eb1fc35a75 (127.3.6.1:41641)
I20260928 13:06:55.055411 22235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.1@KRBTEST.COM'} at 127.3.6.1:43473
WARNING: no policy specified for kudu/127.3.6.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
Entry for principal kudu/127.3.6.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab.
I20260928 13:06:55.078924  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:55.164383 22431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.164598 22431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.164624 22431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.165768 22431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.165807 22431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.165832 22431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:55.167420 22431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.2.keytab
--principal=kudu/127.3.6.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.167621 22431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.167812 22431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.173017 22439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.173023 22436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.173178 22431 server_base.cc:1034] running on GCE node
W20260928 13:06:55.173051 22437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.173463 22431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.173743 22431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.174911 22431 hybrid_clock.cc:648] HybridClock initialized: now 1790600815174908 us; error 42 us; skew 500 ppm
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:55.177486 22431 init.cc:377] Logged in from keytab as kudu/127.3.6.2@KRBTEST.COM (short username kudu)
I20260928 13:06:55.177999 22431 webserver.cc:460] Webserver started at http://127.3.6.2:46139/ using document root <none> and password file <none>
I20260928 13:06:55.178246 22431 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.178311 22431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.178462 22431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.179576 22431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "ce4296406c3d43b1b4d6028f9d7005dd"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "9e1855300c2842ccf99fa52fe794d117"
server_key_iv: "7ddcef7c43f595aea3e902a9187513b8"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.179939 22431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "ce4296406c3d43b1b4d6028f9d7005dd"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "9e1855300c2842ccf99fa52fe794d117"
server_key_iv: "7ddcef7c43f595aea3e902a9187513b8"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.181273 22431 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:55.182021 22446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.182222 22431 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:55.182313 22431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "ce4296406c3d43b1b4d6028f9d7005dd"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "9e1855300c2842ccf99fa52fe794d117"
server_key_iv: "7ddcef7c43f595aea3e902a9187513b8"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.182396 22431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.207705 22431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.209616 22431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.209791 22431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.210042 22431 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:55.210350 22431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:55.210403 22431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.210443 22431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:55.210474 22431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.216449 22431 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:44711
I20260928 13:06:55.216496 22559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:44711 every 8 connection(s)
I20260928 13:06:55.216845 22431 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.2@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:55.224370  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22431
I20260928 13:06:55.224499  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:55.224720  3096 external_mini_cluster.cc:1428] Setting key b4327f1a260268e6d3b58f05cdbefb3d
I20260928 13:06:55.226835 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.217637 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:39299 (local address 127.3.6.62:38523)
0928 13:06:55.217684 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.217686 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.217857 (+   171us) server_negotiation.cc:407] Connection header received
0928 13:06:55.218392 (+   535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.218393 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.218404 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.218470 (+    66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.219542 (+  1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.220062 (+   520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.221070 (+  1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.221266 (+   196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.221326 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.223685 (+  2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.223687 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.223687 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:55.223694 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.225261 (+  1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.225746 (+   485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.225747 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.225748 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.225817 (+    69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.226062 (+   245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.226062 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.226063 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.226215 (+   152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.226285 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.226578 (+   293us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.226683 (+   105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:06:55.227228 22562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.217572 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38523 (local address 127.3.6.2:39299)
0928 13:06:55.217730 (+   158us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.217772 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.218264 (+   492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.218548 (+   284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.218551 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.219202 (+   651us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:55.219444 (+   242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.219450 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.220149 (+   699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.220150 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.220986 (+   836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.220989 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.221335 (+   346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.221345 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.221446 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.221972 (+   526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:55.221981 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:55.223578 (+  1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:55.225389 (+  1811us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.225396 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.225399 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.225663 (+   264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.225885 (+   222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.225886 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.225886 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.225986 (+   100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.226306 (+   320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:55.226312 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:55.226442 (+   130us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.226537 (+    95us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.226699 (+   162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260928 13:06:55.227789 22560 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38523
I20260928 13:06:55.227908 22560 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:55.228098 22560 heartbeater.cc:511] Master 127.3.6.62:38523 requested a full tablet report, sending...
I20260928 13:06:55.228490 22235 ts_manager.cc:194] Registered new tserver with Master: ce4296406c3d43b1b4d6028f9d7005dd (127.3.6.2:44711)
I20260928 13:06:55.229015 22235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.2@KRBTEST.COM'} at 127.3.6.2:39299
WARNING: no policy specified for kudu/127.3.6.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
Entry for principal kudu/127.3.6.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab.
I20260928 13:06:55.250634  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38731
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:55.331838 22565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.332041 22565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.332064 22565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.333199 22565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.333243 22565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.333277 22565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:55.334766 22565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38731
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.3.keytab
--principal=kudu/127.3.6.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:38523
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.334955 22565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.335222 22565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.340335 22570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.340335 22573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.340348 22571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.340682 22565 server_base.cc:1034] running on GCE node
I20260928 13:06:55.340992 22565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.341318 22565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.342495 22565 hybrid_clock.cc:648] HybridClock initialized: now 1790600815342479 us; error 30 us; skew 500 ppm
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:55.345254 22565 init.cc:377] Logged in from keytab as kudu/127.3.6.3@KRBTEST.COM (short username kudu)
I20260928 13:06:55.345796 22565 webserver.cc:460] Webserver started at http://127.3.6.3:37173/ using document root <none> and password file <none>
I20260928 13:06:55.346043 22565 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.346088 22565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.346258 22565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.347409 22565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "780b13d78ca248649ef973ed6b4f96a2"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "8b5544a770af126a8fca6b24129cbde2"
server_key_iv: "47adee6e901980fd7246f8b9b0473624"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.347769 22565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "780b13d78ca248649ef973ed6b4f96a2"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "8b5544a770af126a8fca6b24129cbde2"
server_key_iv: "47adee6e901980fd7246f8b9b0473624"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.349125 22565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:55.349895 22580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.350066 22565 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:55.350171 22565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "780b13d78ca248649ef973ed6b4f96a2"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "8b5544a770af126a8fca6b24129cbde2"
server_key_iv: "47adee6e901980fd7246f8b9b0473624"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.350243 22565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.359360 22565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.361238 22565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.361411 22565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.361661 22565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:55.361976 22565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:55.362033 22565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.362076 22565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:55.362105 22565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.368098 22565 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:39007
I20260928 13:06:55.368137 22693 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:39007 every 8 connection(s)
I20260928 13:06:55.368471 22565 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
Sep 28 13:06:55 dist-test-slave-ddvw krb5kdc[22190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600815, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.3@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:06:55.375677  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22565
I20260928 13:06:55.375808  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:55.375994  3096 external_mini_cluster.cc:1428] Setting key a17f6e8d5a853840a5e0410e38b697c8
I20260928 13:06:55.378433 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.369158 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:47127 (local address 127.3.6.62:38523)
0928 13:06:55.369225 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.369227 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.369498 (+   271us) server_negotiation.cc:407] Connection header received
0928 13:06:55.370019 (+   521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.370021 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.370033 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.370090 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.371075 (+   985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.371618 (+   543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.372683 (+  1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.372899 (+   216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.372988 (+    89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.375266 (+  2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.375268 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.375268 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:55.375278 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.376923 (+  1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.377385 (+   462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.377387 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.377387 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.377457 (+    70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.377734 (+   277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.377735 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.377735 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.377864 (+   129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.377943 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.378232 (+   289us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.378341 (+   109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 13:06:55.378636 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.369155 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:38523 (local address 127.3.6.3:47127)
0928 13:06:55.369374 (+   219us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.369411 (+    37us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.369911 (+   500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.370171 (+   260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.370174 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.370738 (+   564us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:55.370941 (+   203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.370946 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.371739 (+   793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.371742 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.372570 (+   828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.372572 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.372987 (+   415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.373002 (+    15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.373128 (+   126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.373630 (+   502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:06:55.373639 (+     9us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:55.375124 (+  1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:55.377036 (+  1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.377043 (+     7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.377046 (+     3us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.377301 (+   255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.377539 (+   238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:06:55.377539 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:06:55.377540 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:06:55.377660 (+   120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:06:55.377933 (+   273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:55.377939 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:55.378095 (+   156us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.378209 (+   114us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.378393 (+   184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":108,"threads_started":1}
I20260928 13:06:55.379196 22694 heartbeater.cc:347] Connected to a master server at 127.3.6.62:38523
I20260928 13:06:55.379285 22694 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:55.379485 22694 heartbeater.cc:511] Master 127.3.6.62:38523 requested a full tablet report, sending...
I20260928 13:06:55.379897 22235 ts_manager.cc:194] Registered new tserver with Master: 780b13d78ca248649ef973ed6b4f96a2 (127.3.6.3:39007)
I20260928 13:06:55.380299 22235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.3.6.3@KRBTEST.COM'} at 127.3.6.3:47127
I20260928 13:06:55.387861  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:55.395665 22291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.389245 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55176 (local address 127.3.6.62:38523)
0928 13:06:55.389312 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.389314 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.389455 (+   141us) server_negotiation.cc:407] Connection header received
0928 13:06:55.389535 (+    80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.389536 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.389547 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.389599 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.390225 (+   626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.390736 (+   511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.391536 (+   800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.391750 (+   214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.391837 (+    87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.393050 (+  1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.393052 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.393052 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:55.393061 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.394401 (+  1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.394765 (+   364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.394767 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.394767 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.394835 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:55.395069 (+   234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:55.395070 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:55.395070 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:55.395239 (+   169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.395365 (+   126us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.395469 (+   104us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.395557 (+    88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:06:55.397452 22235 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55176:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:55.399185 22235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:55.405982 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401793 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60476 (local address 127.3.6.2:44711)
0928 13:06:55.401967 (+   174us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.401977 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.402013 (+    36us) server_negotiation.cc:407] Connection header received
0928 13:06:55.402089 (+    76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.402091 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.402103 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.402202 (+    99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:55.402406 (+   204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403321 (+   915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.404799 (+  1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.405528 (+   729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405601 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.405657 (+    56us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.405842 (+   185us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.405883 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260928 13:06:55.405995 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401530 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44711 (local address 127.0.0.1:60476)
0928 13:06:55.401965 (+   435us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.401974 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.402021 (+    47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.402214 (+   193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.402219 (+     5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.402221 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:55.402297 (+    76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.402298 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403423 (+  1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.403424 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.404705 (+  1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.404707 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.405621 (+   914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405622 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.405709 (+    87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.405726 (+    17us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.405824 (+    98us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.405895 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":92,"threads_started":1}
I20260928 13:06:55.406141 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401508 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:41641 (local address 127.0.0.1:45680)
0928 13:06:55.401675 (+   167us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.401717 (+    42us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.401809 (+    92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.402482 (+   673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.402483 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.402485 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:55.402560 (+    75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.402563 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403929 (+  1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.403930 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.405043 (+  1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.405045 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.405917 (+   872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405917 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.405994 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.405997 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.406032 (+    35us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.406075 (+    43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":80,"thread_start_us":49,"threads_started":1}
I20260928 13:06:55.406363 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401530 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:39007 (local address 127.0.0.1:50996)
0928 13:06:55.402095 (+   565us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.402102 (+     7us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.402154 (+    52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.402484 (+   330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.402484 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.402485 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:55.402560 (+    75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.402562 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403957 (+  1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.403958 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.405142 (+  1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.405145 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.406083 (+   938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.406085 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.406162 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.406168 (+     6us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.406224 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.406282 (+    58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":22,"thread_start_us":94,"threads_started":1}
I20260928 13:06:55.406539 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401623 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45680 (local address 127.3.6.1:41641)
0928 13:06:55.402283 (+   660us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.402287 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.402297 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:55.402365 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.402368 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.402383 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.402637 (+   254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:55.402714 (+    77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403821 (+  1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405138 (+  1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.405818 (+   680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.406264 (+   446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.406337 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.406371 (+    34us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.406431 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":82,"threads_started":1}
I20260928 13:06:55.406661 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.401763 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50996 (local address 127.3.6.3:39007)
0928 13:06:55.401961 (+   198us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.401966 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.402153 (+   187us) server_negotiation.cc:407] Connection header received
0928 13:06:55.402221 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.402224 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.402241 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.402398 (+   157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:55.402641 (+   243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.403838 (+  1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405244 (+  1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.405926 (+   682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.405993 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.406046 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.406528 (+   482us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.406570 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":98,"threads_started":1}
I20260928 13:06:55.407318 22360 tablet_service.cc:1467] Processing CreateTablet for tablet c33cacd710c44694bb7b2650f0ce24ad (DEFAULT_TABLE table=test-table [id=c9ffabc49e414229873b66887b64d58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:55.407330 22494 tablet_service.cc:1467] Processing CreateTablet for tablet c33cacd710c44694bb7b2650f0ce24ad (DEFAULT_TABLE table=test-table [id=c9ffabc49e414229873b66887b64d58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:55.407644 22494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33cacd710c44694bb7b2650f0ce24ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:55.407640 22360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33cacd710c44694bb7b2650f0ce24ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:55.410230 22628 tablet_service.cc:1467] Processing CreateTablet for tablet c33cacd710c44694bb7b2650f0ce24ad (DEFAULT_TABLE table=test-table [id=c9ffabc49e414229873b66887b64d58a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:55.410447 22712 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Bootstrap starting.
I20260928 13:06:55.410507 22711 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: Bootstrap starting.
I20260928 13:06:55.410584 22628 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c33cacd710c44694bb7b2650f0ce24ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:55.411108 22712 tablet_bootstrap.cc:654] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:55.411252 22711 tablet_bootstrap.cc:654] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:55.411695 22712 log.cc:824] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:55.411898 22711 log.cc:824] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:55.412477 22712 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: No bootstrap required, opened a new log
I20260928 13:06:55.412561 22712 ts_tablet_manager.cc:1397] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:55.412734 22711 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: No bootstrap required, opened a new log
I20260928 13:06:55.412817 22711 ts_tablet_manager.cc:1397] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.002s
I20260928 13:06:55.414011 22712 raft_consensus.cc:348] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.414175 22712 raft_consensus.cc:374] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:55.414224 22712 raft_consensus.cc:729] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4296406c3d43b1b4d6028f9d7005dd, State: Initialized, Role: FOLLOWER
I20260928 13:06:55.414347 22712 consensus_queue.cc:260] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.414661 22712 ts_tablet_manager.cc:1428] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:55.414845 22560 heartbeater.cc:503] Master 127.3.6.62:38523 was elected leader, sending a full tablet report...
I20260928 13:06:55.415283 22715 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Bootstrap starting.
I20260928 13:06:55.415169 22711 raft_consensus.cc:348] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.415361 22711 raft_consensus.cc:374] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:55.415400 22711 raft_consensus.cc:729] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2209a4dc25664f44964509eb1fc35a75, State: Initialized, Role: FOLLOWER
I20260928 13:06:55.415522 22711 consensus_queue.cc:260] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.415823 22711 ts_tablet_manager.cc:1428] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.001s
I20260928 13:06:55.415968 22426 heartbeater.cc:503] Master 127.3.6.62:38523 was elected leader, sending a full tablet report...
I20260928 13:06:55.416029 22715 tablet_bootstrap.cc:654] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:55.416677 22715 log.cc:824] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:55.417514 22715 tablet_bootstrap.cc:492] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: No bootstrap required, opened a new log
I20260928 13:06:55.417629 22715 ts_tablet_manager.cc:1397] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260928 13:06:55.419251 22715 raft_consensus.cc:348] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.419420 22715 raft_consensus.cc:374] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:55.419476 22715 raft_consensus.cc:729] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 780b13d78ca248649ef973ed6b4f96a2, State: Initialized, Role: FOLLOWER
I20260928 13:06:55.419602 22715 consensus_queue.cc:260] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.419883 22715 ts_tablet_manager.cc:1428] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260928 13:06:55.419947 22694 heartbeater.cc:503] Master 127.3.6.62:38523 was elected leader, sending a full tablet report...
W20260928 13:06:55.467527 22561 tablet.cc:2369] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 13:06:55.468225 22719 raft_consensus.cc:482] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:55.468379 22719 raft_consensus.cc:504] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.468775 22719 leader_election.cc:288] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2209a4dc25664f44964509eb1fc35a75 (127.3.6.1:41641), ce4296406c3d43b1b4d6028f9d7005dd (127.3.6.2:44711)
I20260928 13:06:55.472975 22708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.469064 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:44993 (local address 127.3.6.1:41641)
0928 13:06:55.469112 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.469114 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.469126 (+    12us) server_negotiation.cc:407] Connection header received
0928 13:06:55.469158 (+    32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.469159 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.469173 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.469240 (+    67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:55.469484 (+   244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.470281 (+   797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.471985 (+  1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.472580 (+   595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.472661 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.472672 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.472862 (+   190us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.472904 (+    42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:06:55.472975 22710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.469138 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:55185 (local address 127.3.6.2:44711)
0928 13:06:55.469189 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.469191 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.469344 (+   153us) server_negotiation.cc:407] Connection header received
0928 13:06:55.469370 (+    26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.469371 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.469382 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.469421 (+    39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:55.469589 (+   168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.470323 (+   734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.471988 (+  1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.472580 (+   592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.472661 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.472672 (+    11us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.472862 (+   190us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.472906 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 13:06:55.472978 22696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.468971 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:41641 (local address 127.3.6.3:44993)
0928 13:06:55.469035 (+    64us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.469047 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.469100 (+    53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.469247 (+   147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.469248 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.469249 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:55.469384 (+   135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.469386 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.470410 (+  1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.470411 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.471872 (+  1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.471876 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.472677 (+   801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.472678 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.472762 (+    84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.472766 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.472827 (+    61us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.472877 (+    50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":90}
I20260928 13:06:55.472988 22720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.469033 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:44711 (local address 127.3.6.3:55185)
0928 13:06:55.469232 (+   199us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.469242 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.469299 (+    57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.469450 (+   151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.469451 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.469453 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:55.469518 (+    65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.469519 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.470411 (+   892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.470411 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.471872 (+  1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.471876 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.472677 (+   801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.472678 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.472768 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.472771 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.472839 (+    68us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.472877 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":101,"thread_start_us":111,"threads_started":1}
I20260928 13:06:55.473392 22380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33cacd710c44694bb7b2650f0ce24ad" candidate_uuid: "780b13d78ca248649ef973ed6b4f96a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2209a4dc25664f44964509eb1fc35a75" is_pre_election: true
I20260928 13:06:55.473428 22514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33cacd710c44694bb7b2650f0ce24ad" candidate_uuid: "780b13d78ca248649ef973ed6b4f96a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" is_pre_election: true
I20260928 13:06:55.473584 22514 raft_consensus.cc:2454] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780b13d78ca248649ef973ed6b4f96a2 in term 0.
I20260928 13:06:55.473585 22380 raft_consensus.cc:2454] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 780b13d78ca248649ef973ed6b4f96a2 in term 0.
I20260928 13:06:55.473855 22583 leader_election.cc:302] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 780b13d78ca248649ef973ed6b4f96a2, ce4296406c3d43b1b4d6028f9d7005dd; no voters: 
I20260928 13:06:55.474004 22719 raft_consensus.cc:2781] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:55.474066 22719 raft_consensus.cc:482] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:55.474083 22719 raft_consensus.cc:3037] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:55.474735 22719 raft_consensus.cc:504] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.474905 22719 leader_election.cc:288] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [CANDIDATE]: Term 1 election: Requested vote from peers 2209a4dc25664f44964509eb1fc35a75 (127.3.6.1:41641), ce4296406c3d43b1b4d6028f9d7005dd (127.3.6.2:44711)
I20260928 13:06:55.475090 22380 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33cacd710c44694bb7b2650f0ce24ad" candidate_uuid: "780b13d78ca248649ef973ed6b4f96a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2209a4dc25664f44964509eb1fc35a75"
I20260928 13:06:55.475116 22514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c33cacd710c44694bb7b2650f0ce24ad" candidate_uuid: "780b13d78ca248649ef973ed6b4f96a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4296406c3d43b1b4d6028f9d7005dd"
I20260928 13:06:55.475171 22380 raft_consensus.cc:3037] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:55.475199 22514 raft_consensus.cc:3037] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:55.475898 22514 raft_consensus.cc:2454] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780b13d78ca248649ef973ed6b4f96a2 in term 1.
I20260928 13:06:55.475953 22380 raft_consensus.cc:2454] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 780b13d78ca248649ef973ed6b4f96a2 in term 1.
I20260928 13:06:55.476104 22583 leader_election.cc:302] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 780b13d78ca248649ef973ed6b4f96a2, ce4296406c3d43b1b4d6028f9d7005dd; no voters: 
I20260928 13:06:55.476219 22719 raft_consensus.cc:2781] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:55.476419 22719 raft_consensus.cc:686] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 1 LEADER]: Becoming Leader. State: Replica: 780b13d78ca248649ef973ed6b4f96a2, State: Running, Role: LEADER
I20260928 13:06:55.476519 22719 consensus_queue.cc:237] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } }
I20260928 13:06:55.477361 22235 catalog_manager.cc:5495] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 780b13d78ca248649ef973ed6b4f96a2 (127.3.6.3). New cstate: current_term: 1 leader_uuid: "780b13d78ca248649ef973ed6b4f96a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "780b13d78ca248649ef973ed6b4f96a2" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 39007 } health_report { overall_health: HEALTHY } } }
I20260928 13:06:55.483830 22709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.481650 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51002 (local address 127.3.6.3:39007)
0928 13:06:55.481703 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.481705 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.481712 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:06:55.481779 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.481780 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.481795 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.481857 (+    62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:55.481955 (+    98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.482388 (+   433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.483177 (+   789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.483353 (+   176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.483403 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.483514 (+   111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:55.483604 (+    90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:55.483657 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.483697 (+    40us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.483713 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 13:06:55.485662 22380 raft_consensus.cc:1261] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 1 FOLLOWER]: Refusing update from remote peer 780b13d78ca248649ef973ed6b4f96a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:55.485666 22514 raft_consensus.cc:1261] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 1 FOLLOWER]: Refusing update from remote peer 780b13d78ca248649ef973ed6b4f96a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:55.486047 22721 consensus_queue.cc:1035] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2209a4dc25664f44964509eb1fc35a75" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:55.486179 22719 consensus_queue.cc:1035] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce4296406c3d43b1b4d6028f9d7005dd" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 44711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:55.489564 22724 mvcc.cc:205] Tried to move back new op lower bound from 7334300940226326528 to 7334300940192620544. Current Snapshot: MvccSnapshot[applied={T|T < 7334300940226326528}]
I20260928 13:06:55.492095 22235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:55.492189 22235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:55.492956 22235 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eba146222517421abe14144bf9799220: Sending DeleteTablet for 3 replicas of tablet c33cacd710c44694bb7b2650f0ce24ad
I20260928 13:06:55.493289 22360 tablet_service.cc:1514] Processing DeleteTablet for tablet c33cacd710c44694bb7b2650f0ce24ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:55 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:45680
I20260928 13:06:55.493333 22628 tablet_service.cc:1514] Processing DeleteTablet for tablet c33cacd710c44694bb7b2650f0ce24ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:55 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:50996
I20260928 13:06:55.493525 22734 tablet_replica.cc:330] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75: stopping tablet replica
I20260928 13:06:55.493644 22734 raft_consensus.cc:2229] T c33cacd710c44694bb7b2650f0ce24ad P 2209a4dc25664f44964509eb1fc35a75 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:55.493630 22494 tablet_service.cc:1514] Processing DeleteTablet for tablet c33cacd710c44694bb7b2650f0ce24ad with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:55 UTC) from {username='kudu', principal='kudu/127.3.6.62@KRBTEST.COM'} at 127.0.0.1:60476
I20260928 13:06:55.493839 22735 tablet_replica.cc:330] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: stopping tablet replica
I20260928 13:06:55.493836  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22297
I20260928 13:06:55.493934 22735 raft_consensus.cc:2229] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:55.494051 22735 raft_consensus.cc:2258] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:55.495144 22735 ts_tablet_manager.cc:1905] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:55.495260 22736 tablet_replica.cc:330] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: stopping tablet replica
I20260928 13:06:55.495352 22736 raft_consensus.cc:2229] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:55.495448 22736 raft_consensus.cc:2258] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:55.496800 22735 ts_tablet_manager.cc:1918] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:55.496846 22736 ts_tablet_manager.cc:1905] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:55.496883 22735 log.cc:1196] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/c33cacd710c44694bb7b2650f0ce24ad
I20260928 13:06:55.497164 22735 ts_tablet_manager.cc:1939] T c33cacd710c44694bb7b2650f0ce24ad P 780b13d78ca248649ef973ed6b4f96a2: Deleting consensus metadata
I20260928 13:06:55.497551 22219 catalog_manager.cc:4841] TS 780b13d78ca248649ef973ed6b4f96a2 (127.3.6.3:39007): tablet c33cacd710c44694bb7b2650f0ce24ad (table test-table [id=c9ffabc49e414229873b66887b64d58a]) successfully deleted
I20260928 13:06:55.498548 22736 ts_tablet_manager.cc:1918] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:55.498651 22736 log.cc:1196] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/c33cacd710c44694bb7b2650f0ce24ad
I20260928 13:06:55.498924 22736 ts_tablet_manager.cc:1939] T c33cacd710c44694bb7b2650f0ce24ad P ce4296406c3d43b1b4d6028f9d7005dd: Deleting consensus metadata
I20260928 13:06:55.499445 22221 catalog_manager.cc:4841] TS ce4296406c3d43b1b4d6028f9d7005dd (127.3.6.2:44711): tablet c33cacd710c44694bb7b2650f0ce24ad (table test-table [id=c9ffabc49e414229873b66887b64d58a]) successfully deleted
W20260928 13:06:55.502444 22220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:41641 (error 108)
I20260928 13:06:55.502689  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22431
I20260928 13:06:55.503736 22707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.503596 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:41641 (local address 127.0.0.1:45690)
0928 13:06:55.503660 (+    64us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.503708 (+    48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:41641: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260928 13:06:55.503950 22220 catalog_manager.cc:4584] TS 2209a4dc25664f44964509eb1fc35a75 (127.3.6.1:41641): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c33cacd710c44694bb7b2650f0ce24ad: Network error: Client connection negotiation failed: client connection to 127.3.6.1:41641: connect: Connection refused (error 111)
I20260928 13:06:55.509004  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22565
I20260928 13:06:55.513924  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22203
2026-09-28T13:06:55Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1939 ms)
[ RUN      ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-28T13:06:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:55Z Disabled control of system clock
I20260928 13:06:55.541070  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36643
--webserver_interface=127.3.6.62
--webserver_port=0
--builtin_ntp_servers=127.3.6.20:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:36643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:55.622360 22741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.622588 22741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.622609 22741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.623792 22741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:55.623835 22741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.623848 22741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.623860 22741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:55.623873 22741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:55.625183 22741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:36643
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:36643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.625382 22741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.625615 22741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.630806 22746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.630875 22741 server_base.cc:1034] running on GCE node
W20260928 13:06:55.630841 22747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.630841 22749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.631297 22741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.631600 22741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.632771 22741 hybrid_clock.cc:648] HybridClock initialized: now 1790600815632754 us; error 45 us; skew 500 ppm
I20260928 13:06:55.634119 22741 webserver.cc:460] Webserver started at http://127.3.6.62:44575/ using document root <none> and password file <none>
I20260928 13:06:55.634387 22741 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.634456 22741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.634615 22741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.635825 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "d2636dce72b948ebb8cd3140902ab745"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "b2f77125ad40eafc88569370870672c5"
server_key_iv: "b60bfbb437ece81619ecc3c62cdec34c"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.636205 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "d2636dce72b948ebb8cd3140902ab745"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "b2f77125ad40eafc88569370870672c5"
server_key_iv: "b60bfbb437ece81619ecc3c62cdec34c"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.637559 22741 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:06:55.638363 22755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.638562 22741 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:55.638665 22741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "d2636dce72b948ebb8cd3140902ab745"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "b2f77125ad40eafc88569370870672c5"
server_key_iv: "b60bfbb437ece81619ecc3c62cdec34c"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.638741 22741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.662022 22741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.662402 22741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.662569 22741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.666975 22741 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:36643
I20260928 13:06:55.667083 22807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:36643 every 8 connection(s)
I20260928 13:06:55.667438 22741 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:55.668440 22808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:55.670773 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: Bootstrap starting.
I20260928 13:06:55.671450 22808 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:55.671777 22808 log.cc:824] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:55.672557 22808 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: No bootstrap required, opened a new log
I20260928 13:06:55.674213 22808 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } }
I20260928 13:06:55.674356 22808 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:55.674381 22808 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2636dce72b948ebb8cd3140902ab745, State: Initialized, Role: FOLLOWER
I20260928 13:06:55.674558 22808 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } }
I20260928 13:06:55.674623 22808 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:55.674666 22808 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:55.674715 22808 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:55.675344 22808 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } }
I20260928 13:06:55.675452 22808 leader_election.cc:302] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2636dce72b948ebb8cd3140902ab745; no voters: 
I20260928 13:06:55.675676 22808 leader_election.cc:288] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:55.675714 22811 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:55.675841 22811 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [term 1 LEADER]: Becoming Leader. State: Replica: d2636dce72b948ebb8cd3140902ab745, State: Running, Role: LEADER
I20260928 13:06:55.675874  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22741
I20260928 13:06:55.675963 22808 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:55.675993  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:55.675935 22811 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } }
I20260928 13:06:55.676173  3096 external_mini_cluster.cc:1428] Setting key 98dd5b0f876ac0d6a27cb95aad2c58ef
I20260928 13:06:55.676288 22811 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2636dce72b948ebb8cd3140902ab745. Latest consensus state: current_term: 1 leader_uuid: "d2636dce72b948ebb8cd3140902ab745" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } } }
I20260928 13:06:55.676362 22811 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:55.676506 22812 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2636dce72b948ebb8cd3140902ab745" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2636dce72b948ebb8cd3140902ab745" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 36643 } } }
I20260928 13:06:55.676615 22816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:55.676654 22812 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:55.677178 22816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:55.678922 22816 catalog_manager.cc:1347] Generated new cluster ID: b6603263950e4c88a386f9a9c5f1fa84
I20260928 13:06:55.678975 22816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:55.682853 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.676879 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56688 (local address 127.3.6.62:36643)
0928 13:06:55.677397 (+   518us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.677406 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.677434 (+    28us) server_negotiation.cc:407] Connection header received
0928 13:06:55.677550 (+   116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.677557 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.677627 (+    70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.677759 (+   132us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.678115 (+   356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.679494 (+  1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.680577 (+  1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.681194 (+   617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.681335 (+   141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.682023 (+   688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.682027 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.682028 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:55.682242 (+   214us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.682296 (+    54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:55.682311 (+    15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.682381 (+    70us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.682451 (+    70us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.682638 (+   187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":97,"threads_started":1}
I20260928 13:06:55.693730 22816 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:55.694258 22816 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:55.697499 22816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: Generated new TSK 0
I20260928 13:06:55.697683 22816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:06:55.701057  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.1:0
--local_ip_for_outbound_sockets=127.3.6.1
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--builtin_ntp_servers=127.3.6.20:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:55.799543 22832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.799774 22832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.799820 22832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.800980 22832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.801045 22832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.801088 22832 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.1
I20260928 13:06:55.802459 22832 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.3.6.1
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.1
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.802755 22832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.803108 22832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.808149 22840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.808149 22837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.808213 22838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.808683 22832 server_base.cc:1034] running on GCE node
I20260928 13:06:55.808894 22832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.809144 22832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.810324 22832 hybrid_clock.cc:648] HybridClock initialized: now 1790600815810298 us; error 42 us; skew 500 ppm
I20260928 13:06:55.811924 22832 webserver.cc:460] Webserver started at http://127.3.6.1:37567/ using document root <none> and password file <none>
I20260928 13:06:55.812193 22832 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.812266 22832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.812455 22832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.813627 22832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data/instance:
uuid: "a147de3d3eee40a2a78946eec99b9434"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "e26a84f384aceecb70527ba6d207c19b"
server_key_iv: "b60c09602304a0a68fd9b24d0a53a661"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.814003 22832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance:
uuid: "a147de3d3eee40a2a78946eec99b9434"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "e26a84f384aceecb70527ba6d207c19b"
server_key_iv: "b60c09602304a0a68fd9b24d0a53a661"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.815428 22832 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:06:55.816255 22846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.816442 22832 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:55.816537 22832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal
uuid: "a147de3d3eee40a2a78946eec99b9434"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "e26a84f384aceecb70527ba6d207c19b"
server_key_iv: "b60c09602304a0a68fd9b24d0a53a661"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.816635 22832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.852085 22832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.852442 22832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.852608 22832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.852865 22832 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:55.853216 22832 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:55.853274 22832 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.853309 22832 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:55.853338 22832 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.859474 22832 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.1:44271
I20260928 13:06:55.859526 22959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.1:44271 every 8 connection(s)
I20260928 13:06:55.859875 22832 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/data/info.pb
I20260928 13:06:55.865594 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.860706 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.1:57859 (local address 127.3.6.62:36643)
0928 13:06:55.860754 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.860756 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.860998 (+   242us) server_negotiation.cc:407] Connection header received
0928 13:06:55.861571 (+   573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.861572 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.861589 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.861639 (+    50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.862393 (+   754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.862905 (+   512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.863992 (+  1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.864203 (+   211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.864298 (+    95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.865277 (+   979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.865278 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.865279 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:55.865287 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.865311 (+    24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:55.865315 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.865381 (+    66us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.865470 (+    89us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.865506 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:06:55.865819 22962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.860671 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36643 (local address 127.3.6.1:57859)
0928 13:06:55.860866 (+   195us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.860900 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.861452 (+   552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.861729 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.861733 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.861755 (+    22us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:55.862282 (+   527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.862287 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.863040 (+   753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.863041 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.863878 (+   837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.863880 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.864301 (+   421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.864375 (+    74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.864513 (+   138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.865117 (+   604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:55.865117 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:55.865149 (+    32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:55.865174 (+    25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:55.865379 (+   205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:55.865386 (+     7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:55.865390 (+     4us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.865467 (+    77us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.865576 (+   109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260928 13:06:55.866382 22960 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36643
I20260928 13:06:55.866472 22960 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:55.866683 22960 heartbeater.cc:511] Master 127.3.6.62:36643 requested a full tablet report, sending...
I20260928 13:06:55.867233  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22832
I20260928 13:06:55.867347  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-0/wal/instance
I20260928 13:06:55.867323 22772 ts_manager.cc:194] Registered new tserver with Master: a147de3d3eee40a2a78946eec99b9434 (127.3.6.1:44271)
I20260928 13:06:55.867527  3096 external_mini_cluster.cc:1428] Setting key c840aed9ae86c4e15a78518cf82debb1
I20260928 13:06:55.868297 22772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.1:57859
I20260928 13:06:55.868737  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.2:0
--local_ip_for_outbound_sockets=127.3.6.2
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--builtin_ntp_servers=127.3.6.20:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:55.953471 22963 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:55.953681 22963 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:55.953701 22963 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:55.954772 22963 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:55.954804 22963 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:55.954828 22963 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.2
I20260928 13:06:55.956184 22963 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.3.6.2
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22963
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.2
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:55.956369 22963 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:55.956604 22963 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:55.961536 22971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.961524 22968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:55.961526 22969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:55.961810 22963 server_base.cc:1034] running on GCE node
I20260928 13:06:55.962029 22963 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:55.962306 22963 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:55.963452 22963 hybrid_clock.cc:648] HybridClock initialized: now 1790600815963450 us; error 40 us; skew 500 ppm
I20260928 13:06:55.964784 22963 webserver.cc:460] Webserver started at http://127.3.6.2:34397/ using document root <none> and password file <none>
I20260928 13:06:55.965027 22963 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:55.965098 22963 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:55.965247 22963 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:55.966311 22963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data/instance:
uuid: "19b81db25b5241e39853af158f80305e"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "7d215ab057f1d254a7d2a8092916f093"
server_key_iv: "77cbb7572d32d3d89bcb27b6986c94d4"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.966673 22963 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance:
uuid: "19b81db25b5241e39853af158f80305e"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "7d215ab057f1d254a7d2a8092916f093"
server_key_iv: "77cbb7572d32d3d89bcb27b6986c94d4"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.968053 22963 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:55.968770 22977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.968933 22963 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:06:55.969030 22963 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal
uuid: "19b81db25b5241e39853af158f80305e"
format_stamp: "Formatted at 2026-09-28 13:06:55 on dist-test-slave-ddvw"
server_key: "7d215ab057f1d254a7d2a8092916f093"
server_key_iv: "77cbb7572d32d3d89bcb27b6986c94d4"
server_key_version: "encryptionkey@0"
I20260928 13:06:55.969113 22963 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:55.978323 22963 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:55.978606 22963 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:55.978761 22963 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:55.978976 22963 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:55.979307 22963 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:55.979363 22963 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.979403 22963 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:55.979434 22963 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:55.985004 22963 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.2:35721
I20260928 13:06:55.985077 23090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.2:35721 every 8 connection(s)
I20260928 13:06:55.985401 22963 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/data/info.pb
I20260928 13:06:55.990370 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.986157 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:35469 (local address 127.3.6.62:36643)
0928 13:06:55.986230 (+    73us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:55.986233 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:55.986495 (+   262us) server_negotiation.cc:407] Connection header received
0928 13:06:55.986967 (+   472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:55.986968 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:55.986978 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:55.987102 (+   124us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:55.987723 (+   621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.988209 (+   486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.989173 (+   964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.989363 (+   190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.989414 (+    51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.990146 (+   732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:55.990147 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:55.990147 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:55.990151 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:55.990165 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:55.990168 (+     3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:55.990210 (+    42us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:55.990291 (+    81us) server_negotiation.cc:299] Negotiation successful
0928 13:06:55.990313 (+    22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 13:06:55.990587 23093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:55.986152 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36643 (local address 127.3.6.2:35469)
0928 13:06:55.986354 (+   202us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:55.986389 (+    35us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:55.986880 (+   491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:55.987156 (+   276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:55.987160 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:55.987168 (+     8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:55.987646 (+   478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.987650 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.988318 (+   668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.988318 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.989098 (+   780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:55.989100 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:55.989425 (+   325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:55.989435 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:55.989542 (+   107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:55.990017 (+   475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:55.990017 (+     0us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:55.990045 (+    28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:55.990068 (+    23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:55.990222 (+   154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:55.990227 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:55.990229 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:06:55.990280 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:06:55.990355 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":104,"threads_started":1}
I20260928 13:06:55.991180 23091 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36643
I20260928 13:06:55.991281 23091 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:55.991457 23091 heartbeater.cc:511] Master 127.3.6.62:36643 requested a full tablet report, sending...
I20260928 13:06:55.991809 22772 ts_manager.cc:194] Registered new tserver with Master: 19b81db25b5241e39853af158f80305e (127.3.6.2:35721)
I20260928 13:06:55.992177 22772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.2:35469
I20260928 13:06:55.993426  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 22963
I20260928 13:06:55.993526  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal/instance
I20260928 13:06:55.993686  3096 external_mini_cluster.cc:1428] Setting key 570b709a7ddbf87e8df88223033cdab9
I20260928 13:06:55.994566  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.3.6.3:0
--local_ip_for_outbound_sockets=127.3.6.3
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--builtin_ntp_servers=127.3.6.20:37707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 13:06:56.075992 23094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:56.076262 23094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:56.076301 23094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:56.077615 23094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:56.077687 23094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:56.077737 23094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.6.3
I20260928 13:06:56.079174 23094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:37707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.3.6.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.3.6.3
--webserver_port=0
--tserver_master_addrs=127.3.6.62:36643
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.3.6.3
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:56.079460 23094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:56.079784 23094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:56.084710 23102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:56.084761 23100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:56.084913 23094 server_base.cc:1034] running on GCE node
W20260928 13:06:56.084722 23099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:56.085237 23094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:56.085500 23094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:56.086663 23094 hybrid_clock.cc:648] HybridClock initialized: now 1790600816086652 us; error 44 us; skew 500 ppm
I20260928 13:06:56.088080 23094 webserver.cc:460] Webserver started at http://127.3.6.3:44427/ using document root <none> and password file <none>
I20260928 13:06:56.088356 23094 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:56.088428 23094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:56.088595 23094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:56.089668 23094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data/instance:
uuid: "960b8b7887aa419e8e9a91ff77391cb6"
format_stamp: "Formatted at 2026-09-28 13:06:56 on dist-test-slave-ddvw"
server_key: "0f9e194e6207d3761a9a7ec04eec346b"
server_key_iv: "51bd2dd0b42bf9fcacc0401bcf02727d"
server_key_version: "encryptionkey@0"
I20260928 13:06:56.090039 23094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance:
uuid: "960b8b7887aa419e8e9a91ff77391cb6"
format_stamp: "Formatted at 2026-09-28 13:06:56 on dist-test-slave-ddvw"
server_key: "0f9e194e6207d3761a9a7ec04eec346b"
server_key_iv: "51bd2dd0b42bf9fcacc0401bcf02727d"
server_key_version: "encryptionkey@0"
I20260928 13:06:56.091400 23094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:06:56.092146 23108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:56.092315 23094 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:06:56.092407 23094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal
uuid: "960b8b7887aa419e8e9a91ff77391cb6"
format_stamp: "Formatted at 2026-09-28 13:06:56 on dist-test-slave-ddvw"
server_key: "0f9e194e6207d3761a9a7ec04eec346b"
server_key_iv: "51bd2dd0b42bf9fcacc0401bcf02727d"
server_key_version: "encryptionkey@0"
I20260928 13:06:56.092489 23094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:56.109898 23094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:56.110209 23094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:56.110365 23094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:56.110590 23094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 13:06:56.110924 23094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 13:06:56.110978 23094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:56.111042 23094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 13:06:56.111071 23094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:56.117231 23094 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.3:38483
I20260928 13:06:56.117334 23221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.3:38483 every 8 connection(s)
I20260928 13:06:56.117621 23094 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/data/info.pb
I20260928 13:06:56.119172  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23094
I20260928 13:06:56.119294  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal/instance
I20260928 13:06:56.119474  3096 external_mini_cluster.cc:1428] Setting key 25b43364482df95c30b054ea64c61e41
I20260928 13:06:56.123178 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.118319 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.3:33729 (local address 127.3.6.62:36643)
0928 13:06:56.118385 (+    66us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.118387 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.118629 (+   242us) server_negotiation.cc:407] Connection header received
0928 13:06:56.119256 (+   627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.119258 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.119270 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.119328 (+    58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:56.120206 (+   878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.120851 (+   645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.121816 (+   965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.121996 (+   180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.122046 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.122933 (+   887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:56.122934 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:56.122935 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:56.122939 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:56.122954 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:56.122958 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:56.123070 (+   112us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.123085 (+    15us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.123116 (+    31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:06:56.123371 23224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.118297 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:36643 (local address 127.3.6.3:33729)
0928 13:06:56.118509 (+   212us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.118543 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.119143 (+   600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.119400 (+   257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.119403 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.119415 (+    12us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:06:56.120111 (+   696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.120117 (+     6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.120930 (+   813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.120930 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.121741 (+   811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.121743 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.122060 (+   317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.122070 (+    10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.122179 (+   109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.122783 (+   604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 13:06:56.122784 (+     1us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:06:56.122824 (+    40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 13:06:56.122848 (+    24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:06:56.123024 (+   176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:06:56.123026 (+     2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:06:56.123028 (+     2us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.123063 (+    35us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.123138 (+    75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":103,"threads_started":1}
I20260928 13:06:56.123833 23222 heartbeater.cc:347] Connected to a master server at 127.3.6.62:36643
I20260928 13:06:56.123932 23222 heartbeater.cc:464] Registering TS with master...
I20260928 13:06:56.124109 23222 heartbeater.cc:511] Master 127.3.6.62:36643 requested a full tablet report, sending...
I20260928 13:06:56.124497 22772 ts_manager.cc:194] Registered new tserver with Master: 960b8b7887aa419e8e9a91ff77391cb6 (127.3.6.3:38483)
I20260928 13:06:56.124887 22772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.3.6.3:33729
I20260928 13:06:56.131464  3096 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 13:06:56.135747 22823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.132800 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56694 (local address 127.3.6.62:36643)
0928 13:06:56.132877 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.132884 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.132926 (+    42us) server_negotiation.cc:407] Connection header received
0928 13:06:56.132981 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.132982 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.132993 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.133040 (+    47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:56.133278 (+   238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.133769 (+   491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.134527 (+   758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.134703 (+   176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.134768 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.135477 (+   709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:56.135478 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:56.135479 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:56.135482 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:56.135495 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:56.135499 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:56.135542 (+    43us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.135584 (+    42us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.135605 (+    21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 13:06:56.137388 22772 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56694:
name: "test-table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260928 13:06:56.138970 22772 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 13:06:56.145557 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141278 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:38483 (local address 127.0.0.1:51146)
0928 13:06:56.141686 (+   408us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.141696 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.141737 (+    41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.142106 (+   369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.142107 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.142110 (+     3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:56.142152 (+    42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.142154 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143442 (+  1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.143443 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.144392 (+   949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.144395 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.145295 (+   900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.145295 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.145354 (+    59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.145365 (+    11us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.145416 (+    51us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.145454 (+    38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":53,"threads_started":1}
I20260928 13:06:56.145568 23234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141525 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51146 (local address 127.3.6.3:38483)
0928 13:06:56.141938 (+   413us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.141942 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.141952 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:56.141988 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.141990 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.142008 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.142227 (+   219us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:56.142286 (+    59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143363 (+  1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.144495 (+  1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.145212 (+   717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.145288 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.145382 (+    94us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.145441 (+    59us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.145485 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":122,"threads_started":1}
I20260928 13:06:56.145973 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141713 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45252 (local address 127.3.6.1:44271)
0928 13:06:56.141880 (+   167us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.141884 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.141894 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:56.141933 (+    39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.141935 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.141951 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.142025 (+    74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:56.142314 (+   289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143205 (+   891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.144709 (+  1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.145432 (+   723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.145497 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.145576 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.145837 (+   261us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.145874 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":91,"threads_started":1}
I20260928 13:06:56.146188 23230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141455 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44271 (local address 127.0.0.1:45252)
0928 13:06:56.141738 (+   283us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.141749 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.141811 (+    62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.142058 (+   247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.142059 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.142061 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:56.142105 (+    44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.142106 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143312 (+  1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.143313 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.144619 (+  1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.144622 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.145515 (+   893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.145515 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.145568 (+    53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.145573 (+     5us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.146078 (+   505us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.146126 (+    48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"mutex_wait_us":55,"thread_start_us":78,"threads_started":1}
I20260928 13:06:56.146404 23156 tablet_service.cc:1467] Processing CreateTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf (DEFAULT_TABLE table=test-table [id=2ac94112f43a40ba951d29eb4c579d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:56.146687 23156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b45146a57d4f2e9a6c2168c02fdebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:56.147176 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141315 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33534 (local address 127.3.6.2:35721)
0928 13:06:56.141513 (+   198us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.141518 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.141531 (+    13us) server_negotiation.cc:407] Connection header received
0928 13:06:56.141582 (+    51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.141584 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.141600 (+    16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.141709 (+   109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:56.141940 (+   231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143175 (+  1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.145616 (+  2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.146801 (+  1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.146878 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.146935 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.147083 (+   148us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.147112 (+    29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260928 13:06:56.147189 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.141222 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.2:35721 (local address 127.0.0.1:33534)
0928 13:06:56.141399 (+   177us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.141438 (+    39us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.141506 (+    68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.141795 (+   289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.141798 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.141800 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:56.141868 (+    68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.141870 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.143257 (+  1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.143258 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.144619 (+  1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.144622 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.146894 (+  2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.146895 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.146959 (+    64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.146962 (+     3us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.147067 (+   105us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.147111 (+    44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":47,"thread_start_us":66,"threads_started":1}
I20260928 13:06:56.147894 23025 tablet_service.cc:1467] Processing CreateTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf (DEFAULT_TABLE table=test-table [id=2ac94112f43a40ba951d29eb4c579d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:56.148263 23025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b45146a57d4f2e9a6c2168c02fdebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:56.150223 23236 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Bootstrap starting.
I20260928 13:06:56.150950 23236 tablet_bootstrap.cc:654] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:56.150970 22894 tablet_service.cc:1467] Processing CreateTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf (DEFAULT_TABLE table=test-table [id=2ac94112f43a40ba951d29eb4c579d77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 13:06:56.151314 23236 log.cc:824] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:56.151360 22894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5b45146a57d4f2e9a6c2168c02fdebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:56.151523 23237 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Bootstrap starting.
I20260928 13:06:56.152073 23236 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: No bootstrap required, opened a new log
I20260928 13:06:56.152108 23237 tablet_bootstrap.cc:654] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:56.152144 23236 ts_tablet_manager.cc:1397] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:56.152402 23237 log.cc:824] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:56.153080 23237 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: No bootstrap required, opened a new log
I20260928 13:06:56.153160 23237 ts_tablet_manager.cc:1397] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260928 13:06:56.154731 23240 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: Bootstrap starting.
I20260928 13:06:56.154961 23236 raft_consensus.cc:348] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.155154 23236 raft_consensus.cc:374] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:56.155215 23236 raft_consensus.cc:729] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 960b8b7887aa419e8e9a91ff77391cb6, State: Initialized, Role: FOLLOWER
I20260928 13:06:56.155190 23237 raft_consensus.cc:348] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.155360 23237 raft_consensus.cc:374] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:56.155337 23236 consensus_queue.cc:260] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.155407 23237 raft_consensus.cc:729] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19b81db25b5241e39853af158f80305e, State: Initialized, Role: FOLLOWER
I20260928 13:06:56.155529 23237 consensus_queue.cc:260] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.155586 23236 ts_tablet_manager.cc:1428] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
I20260928 13:06:56.155637 23222 heartbeater.cc:503] Master 127.3.6.62:36643 was elected leader, sending a full tablet report...
I20260928 13:06:56.155697 23240 tablet_bootstrap.cc:654] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:56.155804 23237 ts_tablet_manager.cc:1428] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260928 13:06:56.155831 23091 heartbeater.cc:503] Master 127.3.6.62:36643 was elected leader, sending a full tablet report...
I20260928 13:06:56.156056 23240 log.cc:824] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:56.156970 23240 tablet_bootstrap.cc:492] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: No bootstrap required, opened a new log
I20260928 13:06:56.157049 23240 ts_tablet_manager.cc:1397] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: Time spent bootstrapping tablet: real 0.002s	user 0.000s	sys 0.001s
I20260928 13:06:56.158958 23240 raft_consensus.cc:348] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.159157 23240 raft_consensus.cc:374] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:56.159183 23240 raft_consensus.cc:729] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a147de3d3eee40a2a78946eec99b9434, State: Initialized, Role: FOLLOWER
I20260928 13:06:56.159299 23240 consensus_queue.cc:260] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.159518 23240 ts_tablet_manager.cc:1428] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: Time spent starting tablet: real 0.002s	user 0.002s	sys 0.001s
I20260928 13:06:56.159582 22960 heartbeater.cc:503] Master 127.3.6.62:36643 was elected leader, sending a full tablet report...
I20260928 13:06:56.162842 23242 raft_consensus.cc:482] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 13:06:56.162922 23242 raft_consensus.cc:504] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.163259 23242 leader_election.cc:288] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 960b8b7887aa419e8e9a91ff77391cb6 (127.3.6.3:38483), a147de3d3eee40a2a78946eec99b9434 (127.3.6.1:44271)
I20260928 13:06:56.166791 23234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.163470 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:50037 (local address 127.3.6.3:38483)
0928 13:06:56.163518 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.163520 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.163530 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:06:56.163585 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.163586 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.163597 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.163655 (+    58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:56.163855 (+   200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.164462 (+   607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.165861 (+  1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.166433 (+   572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.166512 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.166522 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.166675 (+   153us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.166714 (+    39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:06:56.166791 23235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.163738 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.3.6.2:55753 (local address 127.3.6.1:44271)
0928 13:06:56.163798 (+    60us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.163800 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.163962 (+   162us) server_negotiation.cc:407] Connection header received
0928 13:06:56.164012 (+    50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.164012 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.164019 (+     7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.164061 (+    42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 13:06:56.164174 (+   113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.164600 (+   426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.165865 (+  1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.166433 (+   568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.166512 (+    79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.166522 (+    10us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.166683 (+   161us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.166723 (+    40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 13:06:56.166808 23093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.163397 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.3:38483 (local address 127.3.6.2:50037)
0928 13:06:56.163460 (+    63us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.163473 (+    13us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.163517 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.163660 (+   143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.163661 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.163663 (+     2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:56.163775 (+   112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.163777 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.164544 (+   767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.164545 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.165745 (+  1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.165748 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.166522 (+   774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.166523 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.166600 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.166606 (+     6us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.166665 (+    59us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.166714 (+    49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":21}
I20260928 13:06:56.166814 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.163537 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44271 (local address 127.3.6.2:55753)
0928 13:06:56.163905 (+   368us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.163914 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:06:56.163959 (+    45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:06:56.164063 (+   104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:06:56.164064 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:06:56.164065 (+     1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 13:06:56.164120 (+    55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.164121 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.164663 (+   542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.164663 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.165790 (+  1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:06:56.165792 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.166522 (+   730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.166523 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:06:56.166600 (+    77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.166606 (+     6us) client_negotiation.cc:769] Sending connection context
0928 13:06:56.166665 (+    59us) client_negotiation.cc:240] Negotiation successful
0928 13:06:56.166712 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":6,"thread_start_us":98,"threads_started":1}
I20260928 13:06:56.167169 23176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b45146a57d4f2e9a6c2168c02fdebf" candidate_uuid: "19b81db25b5241e39853af158f80305e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960b8b7887aa419e8e9a91ff77391cb6" is_pre_election: true
I20260928 13:06:56.167331 23176 raft_consensus.cc:2454] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b81db25b5241e39853af158f80305e in term 0.
I20260928 13:06:56.167366 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b45146a57d4f2e9a6c2168c02fdebf" candidate_uuid: "19b81db25b5241e39853af158f80305e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a147de3d3eee40a2a78946eec99b9434" is_pre_election: true
I20260928 13:06:56.167466 22914 raft_consensus.cc:2454] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19b81db25b5241e39853af158f80305e in term 0.
I20260928 13:06:56.167580 22978 leader_election.cc:302] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19b81db25b5241e39853af158f80305e, 960b8b7887aa419e8e9a91ff77391cb6; no voters: 
I20260928 13:06:56.167750 23242 raft_consensus.cc:2781] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 13:06:56.167824 23242 raft_consensus.cc:482] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 13:06:56.167858 23242 raft_consensus.cc:3037] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:56.168565 23242 raft_consensus.cc:504] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.168704 23242 leader_election.cc:288] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [CANDIDATE]: Term 1 election: Requested vote from peers 960b8b7887aa419e8e9a91ff77391cb6 (127.3.6.3:38483), a147de3d3eee40a2a78946eec99b9434 (127.3.6.1:44271)
I20260928 13:06:56.168843 23176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b45146a57d4f2e9a6c2168c02fdebf" candidate_uuid: "19b81db25b5241e39853af158f80305e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "960b8b7887aa419e8e9a91ff77391cb6"
I20260928 13:06:56.168869 22914 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5b45146a57d4f2e9a6c2168c02fdebf" candidate_uuid: "19b81db25b5241e39853af158f80305e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a147de3d3eee40a2a78946eec99b9434"
I20260928 13:06:56.168915 23176 raft_consensus.cc:3037] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:56.168977 22914 raft_consensus.cc:3037] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:56.169625 23176 raft_consensus.cc:2454] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b81db25b5241e39853af158f80305e in term 1.
I20260928 13:06:56.169817 22914 raft_consensus.cc:2454] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19b81db25b5241e39853af158f80305e in term 1.
I20260928 13:06:56.169979 22978 leader_election.cc:302] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19b81db25b5241e39853af158f80305e, 960b8b7887aa419e8e9a91ff77391cb6; no voters: 
I20260928 13:06:56.170060 23242 raft_consensus.cc:2781] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:56.170241 23242 raft_consensus.cc:686] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 1 LEADER]: Becoming Leader. State: Replica: 19b81db25b5241e39853af158f80305e, State: Running, Role: LEADER
I20260928 13:06:56.170352 23242 consensus_queue.cc:237] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } }
I20260928 13:06:56.171164 22771 catalog_manager.cc:5495] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e reported cstate change: term changed from 0 to 1, leader changed from <none> to 19b81db25b5241e39853af158f80305e (127.3.6.2). New cstate: current_term: 1 leader_uuid: "19b81db25b5241e39853af158f80305e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19b81db25b5241e39853af158f80305e" member_type: VOTER last_known_addr { host: "127.3.6.2" port: 35721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 } health_report { overall_health: UNKNOWN } } }
I20260928 13:06:56.180421 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.178286 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33540 (local address 127.3.6.2:35721)
0928 13:06:56.178348 (+    62us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:56.178350 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:56.178357 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:06:56.178384 (+    27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:56.178384 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:56.178399 (+    15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:56.178458 (+    59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:06:56.178563 (+   105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.179091 (+   528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.179815 (+   724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:56.179990 (+   175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:56.180038 (+    48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:56.180162 (+   124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:06:56.180252 (+    90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:06:56.180309 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:56.180340 (+    31us) server_negotiation.cc:299] Negotiation successful
0928 13:06:56.180354 (+    14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 13:06:56.182044 22914 raft_consensus.cc:1261] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 1 FOLLOWER]: Refusing update from remote peer 19b81db25b5241e39853af158f80305e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:56.182053 23176 raft_consensus.cc:1261] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 1 FOLLOWER]: Refusing update from remote peer 19b81db25b5241e39853af158f80305e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:06:56.182389 23246 consensus_queue.cc:1035] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [LEADER]: Connected to new peer: Peer: permanent_uuid: "960b8b7887aa419e8e9a91ff77391cb6" member_type: VOTER last_known_addr { host: "127.3.6.3" port: 38483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:56.182526 23242 consensus_queue.cc:1035] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a147de3d3eee40a2a78946eec99b9434" member_type: VOTER last_known_addr { host: "127.3.6.1" port: 44271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:06:56.184762 23249 mvcc.cc:205] Tried to move back new op lower bound from 7334300943079346176 to 7334300943034511360. Current Snapshot: MvccSnapshot[applied={T|T < 7334300943079346176}]
I20260928 13:06:56.184988 23250 mvcc.cc:205] Tried to move back new op lower bound from 7334300943079346176 to 7334300943034511360. Current Snapshot: MvccSnapshot[applied={T|T < 7334300943079346176}]
I20260928 13:06:56.185561 23251 mvcc.cc:205] Tried to move back new op lower bound from 7334300943079346176 to 7334300943034511360. Current Snapshot: MvccSnapshot[applied={T|T < 7334300943079346176 or (T in {7334300943079346176})}]
I20260928 13:06:56.186803 22771 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:56.186878 22771 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 13:06:56.187595 22771 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d2636dce72b948ebb8cd3140902ab745: Sending DeleteTablet for 3 replicas of tablet d5b45146a57d4f2e9a6c2168c02fdebf
I20260928 13:06:56.187928 23025 tablet_service.cc:1514] Processing DeleteTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:56 UTC) from {username='slave'} at 127.0.0.1:33534
I20260928 13:06:56.188027 23156 tablet_service.cc:1514] Processing DeleteTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:56 UTC) from {username='slave'} at 127.0.0.1:51146
I20260928 13:06:56.188143 23259 tablet_replica.cc:330] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: stopping tablet replica
I20260928 13:06:56.188249 23259 raft_consensus.cc:2229] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 1 LEADER]: Raft consensus shutting down.
I20260928 13:06:56.188277 23260 tablet_replica.cc:330] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: stopping tablet replica
I20260928 13:06:56.188258 22894 tablet_service.cc:1514] Processing DeleteTablet for tablet d5b45146a57d4f2e9a6c2168c02fdebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 13:06:56 UTC) from {username='slave'} at 127.0.0.1:45252
I20260928 13:06:56.188351 23260 raft_consensus.cc:2229] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:56.188357 23259 raft_consensus.cc:2258] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:56.188437 23260 raft_consensus.cc:2258] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 13:06:56.188701  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22832
I20260928 13:06:56.188788 23261 tablet_replica.cc:330] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434: stopping tablet replica
I20260928 13:06:56.188799 23259 ts_tablet_manager.cc:1905] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:56.188932 23261 raft_consensus.cc:2229] T d5b45146a57d4f2e9a6c2168c02fdebf P a147de3d3eee40a2a78946eec99b9434 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 13:06:56.191247 23259 ts_tablet_manager.cc:1918] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:56.191323 23259 log.cc:1196] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-1/wal/wals/d5b45146a57d4f2e9a6c2168c02fdebf
I20260928 13:06:56.191573 23259 ts_tablet_manager.cc:1939] T d5b45146a57d4f2e9a6c2168c02fdebf P 19b81db25b5241e39853af158f80305e: Deleting consensus metadata
I20260928 13:06:56.191991 22759 catalog_manager.cc:4841] TS 19b81db25b5241e39853af158f80305e (127.3.6.2:35721): tablet d5b45146a57d4f2e9a6c2168c02fdebf (table test-table [id=2ac94112f43a40ba951d29eb4c579d77]) successfully deleted
W20260928 13:06:56.193862 22756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.3.6.1:44271 (error 108)
I20260928 13:06:56.194455 23231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:56.194305 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.1:44271 (local address 127.0.0.1:45254)
0928 13:06:56.194373 (+    68us) negotiation.cc:107] Waiting for socket to connect
0928 13:06:56.194422 (+    49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.1:44271: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260928 13:06:56.194573 22756 catalog_manager.cc:4584] TS a147de3d3eee40a2a78946eec99b9434 (127.3.6.1:44271): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5b45146a57d4f2e9a6c2168c02fdebf: Network error: Client connection negotiation failed: client connection to 127.3.6.1:44271: connect: Connection refused (error 111)
I20260928 13:06:56.195003  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22963
I20260928 13:06:56.196622 23260 ts_tablet_manager.cc:1905] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 13:06:56.198021 23260 ts_tablet_manager.cc:1918] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 13:06:56.198107 23260 log.cc:1196] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Deleting WAL directory at /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790600576430005-3096-0/minicluster-data/ts-2/wal/wals/d5b45146a57d4f2e9a6c2168c02fdebf
I20260928 13:06:56.198366 23260 ts_tablet_manager.cc:1939] T d5b45146a57d4f2e9a6c2168c02fdebf P 960b8b7887aa419e8e9a91ff77391cb6: Deleting consensus metadata
I20260928 13:06:56.198760 22756 catalog_manager.cc:4841] TS 960b8b7887aa419e8e9a91ff77391cb6 (127.3.6.3:38483): tablet d5b45146a57d4f2e9a6c2168c02fdebf (table test-table [id=2ac94112f43a40ba951d29eb4c579d77]) successfully deleted
I20260928 13:06:56.199762  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23094
I20260928 13:06:56.204104  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 22741
2026-09-28T13:06:56Z chronyd exiting
[       OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (689 ms)
[----------] 6 tests from EncryptionPolicyTest (7874 ms total)

[----------] 18 tests from AuthTokenIssuingTest
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:56 dist-test-slave-ddvw krb5kdc[23265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:56 dist-test-slave-ddvw krb5kdc[23265](info): set up 2 sockets
Sep 28 13:06:56 dist-test-slave-ddvw krb5kdc[23265](info): commencing operation
krb5kdc: starting...
W20260928 13:06:57.243098  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.020s	user 0.003s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:06:57.370776  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36831
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36831
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:57.453747 23278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:57.453984 23278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:57.454008 23278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:57.455224 23278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:57.455269 23278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:57.455286 23278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:57.455297 23278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:57.455309 23278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:57.456787 23278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36831
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36831
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:57.456995 23278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:57.457178 23278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:57.462096 23286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:57.462108 23283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:57.462117 23284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:57.462471 23278 server_base.cc:1034] running on GCE node
I20260928 13:06:57.462752 23278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:57.463114 23278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:57.464309 23278 hybrid_clock.cc:648] HybridClock initialized: now 1790600817464293 us; error 30 us; skew 500 ppm
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600817, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:57.466921 23278 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:06:57.467401 23278 webserver.cc:460] Webserver started at http://127.0.0.1:42693/ using document root <none> and password file <none>
I20260928 13:06:57.467592 23278 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:57.467634 23278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:57.467731 23278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:57.468782 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "2a51935a315241fdb4200eb35e552ca7"
format_stamp: "Formatted at 2026-09-28 13:06:57 on dist-test-slave-ddvw"
server_key: "f6e6aefcb28486fd58895f4879c68396"
server_key_iv: "15cd5e3088f6daa2490fb7543efc1c24"
server_key_version: "encryptionkey@0"
I20260928 13:06:57.469086 23278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "2a51935a315241fdb4200eb35e552ca7"
format_stamp: "Formatted at 2026-09-28 13:06:57 on dist-test-slave-ddvw"
server_key: "f6e6aefcb28486fd58895f4879c68396"
server_key_iv: "15cd5e3088f6daa2490fb7543efc1c24"
server_key_version: "encryptionkey@0"
I20260928 13:06:57.470399 23278 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:06:57.471129 23293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:57.471329 23278 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:06:57.471418 23278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "2a51935a315241fdb4200eb35e552ca7"
format_stamp: "Formatted at 2026-09-28 13:06:57 on dist-test-slave-ddvw"
server_key: "f6e6aefcb28486fd58895f4879c68396"
server_key_iv: "15cd5e3088f6daa2490fb7543efc1c24"
server_key_version: "encryptionkey@0"
I20260928 13:06:57.471475 23278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:57.490512 23278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:57.492506 23278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:57.492619 23278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:57.496496 23278 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36831
I20260928 13:06:57.496573 23345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36831 every 8 connection(s)
I20260928 13:06:57.496965 23278 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:57.498070 23346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:57.500420 23346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7: Bootstrap starting.
I20260928 13:06:57.500999 23346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:57.501289 23346 log.cc:824] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:57.501958 23346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7: No bootstrap required, opened a new log
I20260928 13:06:57.503556 23346 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } }
I20260928 13:06:57.503716 23346 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:57.503762 23346 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a51935a315241fdb4200eb35e552ca7, State: Initialized, Role: FOLLOWER
I20260928 13:06:57.503928 23346 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } }
I20260928 13:06:57.504011 23346 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:57.504053 23346 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:57.504137 23346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:57.504663 23346 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } }
I20260928 13:06:57.504818 23346 leader_election.cc:302] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a51935a315241fdb4200eb35e552ca7; no voters: 
I20260928 13:06:57.504997 23346 leader_election.cc:288] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:57.505025 23349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:57.505226 23349 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [term 1 LEADER]: Becoming Leader. State: Replica: 2a51935a315241fdb4200eb35e552ca7, State: Running, Role: LEADER
I20260928 13:06:57.505268 23346 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:57.505316 23349 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } }
I20260928 13:06:57.505687 23351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a51935a315241fdb4200eb35e552ca7. Latest consensus state: current_term: 1 leader_uuid: "2a51935a315241fdb4200eb35e552ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } } }
I20260928 13:06:57.505774 23351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:57.505823 23350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a51935a315241fdb4200eb35e552ca7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a51935a315241fdb4200eb35e552ca7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36831 } } }
I20260928 13:06:57.505892 23350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:57.505986 23355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:57.505985  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23278
I20260928 13:06:57.506093  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:57.506304  3096 external_mini_cluster.cc:1428] Setting key dccc84d698aeacd772a3756253eca9bc
I20260928 13:06:57.506520 23355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:57.508394 23355 catalog_manager.cc:1347] Generated new cluster ID: 57c97fe12d1e4518b4d937b66aea721a
I20260928 13:06:57.508450 23355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600817, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 13:06:57.517262 23362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:57.506941 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37317 (local address 127.0.0.1:36831)
0928 13:06:57.507330 (+   389us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:57.507339 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:57.507373 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:06:57.507559 (+   186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:57.507586 (+    27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:57.507646 (+    60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:57.507786 (+   140us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:57.508604 (+   818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:57.509502 (+   898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:57.510274 (+   772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:57.510694 (+   420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:57.510810 (+   116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:57.513236 (+  2426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:57.513240 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:57.513241 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:57.513254 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:57.515521 (+  2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:57.515923 (+   402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:57.515928 (+     5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:57.515929 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:57.516192 (+   263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:57.516416 (+   224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:57.516417 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:57.516418 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:57.516666 (+   248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:57.516854 (+   188us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:57.516940 (+    86us) server_negotiation.cc:299] Negotiation successful
0928 13:06:57.517042 (+   102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":83,"threads_started":1}
I20260928 13:06:57.518244  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:06:57.525727 23362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:57.519757 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49235 (local address 127.0.0.1:36831)
0928 13:06:57.519797 (+    40us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:57.519799 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:57.519806 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:06:57.519829 (+    23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:57.519830 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:57.519840 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:57.519895 (+    55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:57.520418 (+   523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:57.520919 (+   501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:57.521625 (+   706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:57.521851 (+   226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:57.521933 (+    82us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:57.523116 (+  1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:57.523117 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:57.523118 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:06:57.523125 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:57.524498 (+  1373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:57.524861 (+   363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:57.524862 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:57.524862 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:57.524917 (+    55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:06:57.525137 (+   220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:06:57.525138 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:06:57.525138 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:06:57.525253 (+   115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:57.525363 (+   110us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:57.525485 (+   122us) server_negotiation.cc:299] Negotiation successful
0928 13:06:57.525545 (+    60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:06:57.533470 23355 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:57.533989 23355 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:57.536693 23355 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a51935a315241fdb4200eb35e552ca7: Generated new TSK 0
I20260928 13:06:57.536877 23355 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:06:57.544039  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23278
W20260928 13:06:57.548378 23263 connection.cc:535] client connection to 127.0.0.1:36831 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36831): Connection reset by peer (error 104)
2026-09-28T13:06:57Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1338 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23377](info): set up 2 sockets
Sep 28 13:06:57 dist-test-slave-ddvw krb5kdc[23377](info): commencing operation
krb5kdc: starting...
W20260928 13:06:58.574941  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.013s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:58 dist-test-slave-ddvw krb5kdc[23377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600818, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:06:58.697741  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42071
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35143
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:06:58.781035 23390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:06:58.781329 23390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:06:58.781373 23390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:06:58.782575 23390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:06:58.782660 23390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:06:58.782683 23390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:06:58.782706 23390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:06:58.782737 23390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:06:58.784365 23390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35143
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42071
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:06:58.784695 23390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:06:58.784946 23390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:06:58.790042 23395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:58.790023 23398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:06:58.790023 23396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:06:58.790246 23390 server_base.cc:1034] running on GCE node
I20260928 13:06:58.790560 23390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:06:58.790879 23390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:06:58.792045 23390 hybrid_clock.cc:648] HybridClock initialized: now 1790600818792053 us; error 69 us; skew 500 ppm
Sep 28 13:06:58 dist-test-slave-ddvw krb5kdc[23377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600818, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:06:58.803632 23390 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:06:58.804199 23390 webserver.cc:460] Webserver started at http://127.0.0.1:46103/ using document root <none> and password file <none>
I20260928 13:06:58.804414 23390 fs_manager.cc:359] Metadata directory not provided
I20260928 13:06:58.804481 23390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:06:58.804590 23390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:06:58.805819 23390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "cbae2c2fdd084402810a9185180b2ab0"
format_stamp: "Formatted at 2026-09-28 13:06:58 on dist-test-slave-ddvw"
server_key: "5537eadd3cbb0df0de9d0f411adf83e0"
server_key_iv: "ca75d9ee784e9a2a6e9a226612edc3bb"
server_key_version: "encryptionkey@0"
I20260928 13:06:58.806182 23390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "cbae2c2fdd084402810a9185180b2ab0"
format_stamp: "Formatted at 2026-09-28 13:06:58 on dist-test-slave-ddvw"
server_key: "5537eadd3cbb0df0de9d0f411adf83e0"
server_key_iv: "ca75d9ee784e9a2a6e9a226612edc3bb"
server_key_version: "encryptionkey@0"
I20260928 13:06:58.807746 23390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:06:58.808696 23405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:06:58.808887 23390 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:06:58.808976 23390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "cbae2c2fdd084402810a9185180b2ab0"
format_stamp: "Formatted at 2026-09-28 13:06:58 on dist-test-slave-ddvw"
server_key: "5537eadd3cbb0df0de9d0f411adf83e0"
server_key_iv: "ca75d9ee784e9a2a6e9a226612edc3bb"
server_key_version: "encryptionkey@0"
I20260928 13:06:58.809034 23390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:06:58.821926 23390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:06:58.824275 23390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:06:58.824396 23390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:06:58.828505 23390 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42071
I20260928 13:06:58.828600 23457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42071 every 8 connection(s)
I20260928 13:06:58.828953 23390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:06:58.830014 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:06:58.832597 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: Bootstrap starting.
I20260928 13:06:58.832878  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23390
I20260928 13:06:58.832973  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:06:58.833166  3096 external_mini_cluster.cc:1428] Setting key 7f1dc0f7169127daf4b7256b30f5a9ca
I20260928 13:06:58.833380 23458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: Neither blocks nor log segments found. Creating new log.
I20260928 13:06:58.833732 23458 log.cc:824] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: Log is configured to *not* fsync() on all Append() calls
I20260928 13:06:58.834573 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: No bootstrap required, opened a new log
I20260928 13:06:58.837080 23458 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } }
I20260928 13:06:58.837226 23458 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:06:58.837248 23458 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbae2c2fdd084402810a9185180b2ab0, State: Initialized, Role: FOLLOWER
I20260928 13:06:58.837388 23458 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } }
I20260928 13:06:58.837462 23458 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:06:58.837505 23458 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:06:58.837555 23458 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:06:58.838300 23458 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } }
I20260928 13:06:58.838409 23458 leader_election.cc:302] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbae2c2fdd084402810a9185180b2ab0; no voters: 
I20260928 13:06:58.838578 23458 leader_election.cc:288] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:06:58.838610 23463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:06:58.838758 23463 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [term 1 LEADER]: Becoming Leader. State: Replica: cbae2c2fdd084402810a9185180b2ab0, State: Running, Role: LEADER
I20260928 13:06:58.838861 23463 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } }
I20260928 13:06:58.838904 23458 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:06:58.839890 23465 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbae2c2fdd084402810a9185180b2ab0. Latest consensus state: current_term: 1 leader_uuid: "cbae2c2fdd084402810a9185180b2ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } } }
I20260928 13:06:58.840000 23465 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:58.840058 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:58.833744 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40191 (local address 127.0.0.1:42071)
0928 13:06:58.833970 (+   226us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:58.833980 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:58.834021 (+    41us) server_negotiation.cc:407] Connection header received
0928 13:06:58.834622 (+   601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:58.834632 (+    10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:58.834713 (+    81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:58.834873 (+   160us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:58.835183 (+   310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:58.836683 (+  1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:58.837620 (+   937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:58.838240 (+   620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:58.838363 (+   123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:58.839127 (+   764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:58.839132 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:58.839132 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:58.839344 (+   212us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:58.839388 (+    44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:58.839407 (+    19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:58.839505 (+    98us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:58.839751 (+   246us) server_negotiation.cc:299] Negotiation successful
0928 13:06:58.839782 (+    31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":95,"threads_started":1}
W20260928 13:06:58.840847 23478 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:06:58.840904 23478 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:06:58.840989  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:06:58.842188 23473 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:06:58.842414 23473 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:06:58.843127 23464 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbae2c2fdd084402810a9185180b2ab0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbae2c2fdd084402810a9185180b2ab0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42071 } } }
I20260928 13:06:58.843607 23464 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0 [sys.catalog]: This master's current role is: LEADER
I20260928 13:06:58.844080 23473 catalog_manager.cc:1347] Generated new cluster ID: 3100ecbb331b4180aa5335c7d35a1571
I20260928 13:06:58.844134 23473 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:06:58.846251 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:06:58.842391 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47515 (local address 127.0.0.1:42071)
0928 13:06:58.842428 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:06:58.842430 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:06:58.842702 (+   272us) server_negotiation.cc:407] Connection header received
0928 13:06:58.842754 (+    52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:06:58.842755 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:06:58.842765 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:06:58.842822 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:06:58.842979 (+   157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:58.843775 (+   796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:58.844823 (+  1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:06:58.845172 (+   349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:06:58.845249 (+    77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:06:58.845993 (+   744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:06:58.845994 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:06:58.845994 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:06:58.845999 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:06:58.846017 (+    18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:06:58.846021 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:06:58.846086 (+    65us) server_negotiation.cc:1035] Waiting for connection context
0928 13:06:58.846161 (+    75us) server_negotiation.cc:299] Negotiation successful
0928 13:06:58.846172 (+    11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:06:58.868410 23473 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:06:58.868978 23473 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:06:58.874437 23473 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbae2c2fdd084402810a9185180b2ab0: Generated new TSK 0
I20260928 13:06:58.874629 23473 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:06:58.880990  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23390
W20260928 13:06:58.885638 23375 connection.cc:535] client connection to 127.0.0.1:42071 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42071): Connection reset by peer (error 104)
2026-09-28T13:06:58Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1337 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:06:58 dist-test-slave-ddvw krb5kdc[23489](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:06:58 dist-test-slave-ddvw krb5kdc[23489](info): set up 2 sockets
Sep 28 13:06:58 dist-test-slave-ddvw krb5kdc[23489](info): commencing operation
krb5kdc: starting...
W20260928 13:06:59.907150  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.008s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:06:59 dist-test-slave-ddvw krb5kdc[23489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600819, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:06:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:06:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:00.028298  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:00.109365 23502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:00.109625 23502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:00.109666 23502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:00.110813 23502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:00.110885 23502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:00.110909 23502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:00.110937 23502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:00.110970 23502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:00.112493 23502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40793
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:00.112783 23502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:00.113018 23502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:00.117875 23510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:00.117844 23507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:00.117909 23508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:00.118225 23502 server_base.cc:1034] running on GCE node
I20260928 13:07:00.118466 23502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:00.118722 23502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:00.119870 23502 hybrid_clock.cc:648] HybridClock initialized: now 1790600820119856 us; error 30 us; skew 500 ppm
Sep 28 13:07:00 dist-test-slave-ddvw krb5kdc[23489](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600820, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:00.122576 23502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:00.123114 23502 webserver.cc:460] Webserver started at http://127.0.0.1:37127/ using document root <none> and password file <none>
I20260928 13:07:00.123361 23502 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:00.123406 23502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:00.123560 23502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:00.124647 23502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "e873cdb2a22c4c21a07ccdeddee50ac7"
format_stamp: "Formatted at 2026-09-28 13:07:00 on dist-test-slave-ddvw"
server_key: "6943967752d099dc1e5e8ddd07e2d8d9"
server_key_iv: "341d4e5a9b68d3a6402a1b82c9da6ba3"
server_key_version: "encryptionkey@0"
I20260928 13:07:00.125005 23502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "e873cdb2a22c4c21a07ccdeddee50ac7"
format_stamp: "Formatted at 2026-09-28 13:07:00 on dist-test-slave-ddvw"
server_key: "6943967752d099dc1e5e8ddd07e2d8d9"
server_key_iv: "341d4e5a9b68d3a6402a1b82c9da6ba3"
server_key_version: "encryptionkey@0"
I20260928 13:07:00.126345 23502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:00.127137 23517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:00.127292 23502 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:00.127381 23502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "e873cdb2a22c4c21a07ccdeddee50ac7"
format_stamp: "Formatted at 2026-09-28 13:07:00 on dist-test-slave-ddvw"
server_key: "6943967752d099dc1e5e8ddd07e2d8d9"
server_key_iv: "341d4e5a9b68d3a6402a1b82c9da6ba3"
server_key_version: "encryptionkey@0"
I20260928 13:07:00.127437 23502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:00.130713 23502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:00.132700 23502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:00.132810 23502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:00.136682 23502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40793
I20260928 13:07:00.136731 23569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40793 every 8 connection(s)
I20260928 13:07:00.137063 23502 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:00.138026 23570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:00.140323 23570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: Bootstrap starting.
I20260928 13:07:00.140837 23570 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:00.141072 23570 log.cc:824] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:00.141710 23570 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: No bootstrap required, opened a new log
I20260928 13:07:00.143390  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23502
I20260928 13:07:00.143523  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:00.143525 23570 raft_consensus.cc:348] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260928 13:07:00.143711  3096 external_mini_cluster.cc:1428] Setting key 4369bc5d78fab3f63474a7f72dc8f2f3
I20260928 13:07:00.143708 23570 raft_consensus.cc:374] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:00.143747 23570 raft_consensus.cc:729] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e873cdb2a22c4c21a07ccdeddee50ac7, State: Initialized, Role: FOLLOWER
I20260928 13:07:00.143898 23570 consensus_queue.cc:260] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260928 13:07:00.144012 23570 raft_consensus.cc:388] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:00.144057 23570 raft_consensus.cc:482] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:00.144107 23570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:00.145031 23570 raft_consensus.cc:504] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260928 13:07:00.145140 23570 leader_election.cc:302] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e873cdb2a22c4c21a07ccdeddee50ac7; no voters: 
I20260928 13:07:00.145308 23570 leader_election.cc:288] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:00.145370 23575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:00.145526 23575 raft_consensus.cc:686] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [term 1 LEADER]: Becoming Leader. State: Replica: e873cdb2a22c4c21a07ccdeddee50ac7, State: Running, Role: LEADER
I20260928 13:07:00.145637 23570 sys_catalog.cc:564] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:00.145677 23575 consensus_queue.cc:237] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } }
I20260928 13:07:00.146126 23574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:00.144207 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33653 (local address 127.0.0.1:40793)
0928 13:07:00.144446 (+   239us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:00.144456 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:00.144495 (+    39us) server_negotiation.cc:407] Connection header received
0928 13:07:00.144604 (+   109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:00.144610 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:00.144634 (+    24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:00.144776 (+   142us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:00.145554 (+   778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:00.145558 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:00.145558 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:00.145564 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:00.145611 (+    47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:00.145627 (+    16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:00.145670 (+    43us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:00.145811 (+   141us) server_negotiation.cc:299] Negotiation successful
0928 13:07:00.145857 (+    46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":104,"threads_started":1}
I20260928 13:07:00.146126 23576 sys_catalog.cc:455] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } } }
I20260928 13:07:00.146250 23576 sys_catalog.cc:458] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:00.146152 23577 sys_catalog.cc:455] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e873cdb2a22c4c21a07ccdeddee50ac7. Latest consensus state: current_term: 1 leader_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e873cdb2a22c4c21a07ccdeddee50ac7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40793 } } }
I20260928 13:07:00.146899 23577 sys_catalog.cc:458] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7 [sys.catalog]: This master's current role is: LEADER
W20260928 13:07:00.147475 23591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:00.147526 23591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:00.147575 23584 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:00.147646  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:00.147738 23584 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:00.149226 23584 catalog_manager.cc:1347] Generated new cluster ID: 69d7c7d75f004f0dbe3a2a6c56c76570
I20260928 13:07:00.149279 23584 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:00.150295 23574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:00.149067 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52445 (local address 127.0.0.1:40793)
0928 13:07:00.149105 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:00.149107 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:00.149256 (+   149us) server_negotiation.cc:407] Connection header received
0928 13:07:00.149356 (+   100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:00.149356 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:00.149362 (+     6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:00.149389 (+    27us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:00.150063 (+   674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:00.150064 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:00.150065 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:00.150069 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:00.150083 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:00.150087 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:00.150118 (+    31us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:00.150223 (+   105us) server_negotiation.cc:299] Negotiation successful
0928 13:07:00.150236 (+    13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:07:00.163885 23584 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:00.164090 23584 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:00.169696 23584 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e873cdb2a22c4c21a07ccdeddee50ac7: Generated new TSK 0
I20260928 13:07:00.169903 23584 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:00.172549  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23502
2026-09-28T13:07:00Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1291 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:00 dist-test-slave-ddvw krb5kdc[23601](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:00 dist-test-slave-ddvw krb5kdc[23601](info): set up 2 sockets
Sep 28 13:07:00 dist-test-slave-ddvw krb5kdc[23601](info): commencing operation
krb5kdc: starting...
W20260928 13:07:01.203229  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.013s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:01.329595  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43753
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:01.414676 23614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:01.414920 23614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:01.414958 23614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:01.416131 23614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:01.416201 23614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:01.416227 23614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:01.416260 23614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:01.416283 23614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:01.417747 23614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:01.418015 23614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:01.418244 23614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:01.423086 23619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:01.423056 23620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:01.423077 23622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:01.423301 23614 server_base.cc:1034] running on GCE node
I20260928 13:07:01.423527 23614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:01.423758 23614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:01.424906 23614 hybrid_clock.cc:648] HybridClock initialized: now 1790600821424889 us; error 28 us; skew 500 ppm
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23601](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600821, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:01.427369 23614 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:01.427745 23614 webserver.cc:460] Webserver started at http://127.0.0.1:46695/ using document root <none> and password file <none>
I20260928 13:07:01.427935 23614 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:01.427981 23614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:01.428067 23614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:01.429065 23614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "725671c521f84ef7a13537bf43fe9878"
format_stamp: "Formatted at 2026-09-28 13:07:01 on dist-test-slave-ddvw"
server_key: "4168daf9e3b057fa9f755ce50975d64b"
server_key_iv: "bd3d97d671217cba815ef2e68ea639aa"
server_key_version: "encryptionkey@0"
I20260928 13:07:01.429361 23614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "725671c521f84ef7a13537bf43fe9878"
format_stamp: "Formatted at 2026-09-28 13:07:01 on dist-test-slave-ddvw"
server_key: "4168daf9e3b057fa9f755ce50975d64b"
server_key_iv: "bd3d97d671217cba815ef2e68ea639aa"
server_key_version: "encryptionkey@0"
I20260928 13:07:01.430579 23614 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:07:01.431295 23629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:01.431475 23614 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:01.431574 23614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "725671c521f84ef7a13537bf43fe9878"
format_stamp: "Formatted at 2026-09-28 13:07:01 on dist-test-slave-ddvw"
server_key: "4168daf9e3b057fa9f755ce50975d64b"
server_key_iv: "bd3d97d671217cba815ef2e68ea639aa"
server_key_version: "encryptionkey@0"
I20260928 13:07:01.431658 23614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:01.461110 23614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:01.463874 23614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:01.464039 23614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:01.468129 23614 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43753
I20260928 13:07:01.468217 23681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43753 every 8 connection(s)
I20260928 13:07:01.468542 23614 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:01.469532 23682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:01.471974 23682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: Bootstrap starting.
I20260928 13:07:01.472571 23682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:01.472860 23682 log.cc:824] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:01.473582 23682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: No bootstrap required, opened a new log
I20260928 13:07:01.474822  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23614
I20260928 13:07:01.474905  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:01.475124  3096 external_mini_cluster.cc:1428] Setting key 6b42f0d3c99a7dd0b55f76cf235ffc61
I20260928 13:07:01.475436 23682 raft_consensus.cc:348] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } }
I20260928 13:07:01.475642 23682 raft_consensus.cc:374] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:01.475682 23682 raft_consensus.cc:729] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 725671c521f84ef7a13537bf43fe9878, State: Initialized, Role: FOLLOWER
I20260928 13:07:01.475864 23682 consensus_queue.cc:260] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } }
I20260928 13:07:01.475957 23682 raft_consensus.cc:388] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:01.475981 23682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:01.476044 23682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:01.476769 23682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } }
I20260928 13:07:01.476886 23682 leader_election.cc:302] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 725671c521f84ef7a13537bf43fe9878; no voters: 
I20260928 13:07:01.477056 23682 leader_election.cc:288] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:01.477115 23687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:01.477257 23687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [term 1 LEADER]: Becoming Leader. State: Replica: 725671c521f84ef7a13537bf43fe9878, State: Running, Role: LEADER
I20260928 13:07:01.477313 23682 sys_catalog.cc:564] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:01.477396 23687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } }
I20260928 13:07:01.477783 23687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 725671c521f84ef7a13537bf43fe9878. Latest consensus state: current_term: 1 leader_uuid: "725671c521f84ef7a13537bf43fe9878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } } }
I20260928 13:07:01.477973 23687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:01.477916 23688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "725671c521f84ef7a13537bf43fe9878" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "725671c521f84ef7a13537bf43fe9878" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43753 } } }
I20260928 13:07:01.478188 23688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878 [sys.catalog]: This master's current role is: LEADER
W20260928 13:07:01.479156 23703 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:01.479212 23703 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:01.479291 23696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:01.479452 23696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:01.481010 23696 catalog_manager.cc:1347] Generated new cluster ID: 16ea346f87524484a91d06fd4a450f0d
I20260928 13:07:01.481063 23696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23601](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 13:07:01.486220 23686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:01.475707 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33117 (local address 127.0.0.1:43753)
0928 13:07:01.475901 (+   194us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:01.475911 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:01.475968 (+    57us) server_negotiation.cc:407] Connection header received
0928 13:07:01.476104 (+   136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:01.476111 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:01.476170 (+    59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:01.476282 (+   112us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:01.477120 (+   838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:01.478560 (+  1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:01.479705 (+  1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:01.480252 (+   547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:01.480392 (+   140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:01.482820 (+  2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:01.482823 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:01.482824 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:01.482835 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:01.484639 (+  1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:01.485030 (+   391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:01.485033 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:01.485034 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:01.485138 (+   104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:01.485356 (+   218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:01.485357 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:01.485358 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:01.485606 (+   248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:01.485768 (+   162us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:01.485876 (+   108us) server_negotiation.cc:299] Negotiation successful
0928 13:07:01.486026 (+   150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":116,"threads_started":1}
I20260928 13:07:01.487187  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:01.501888 23686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:01.495440 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49885 (local address 127.0.0.1:43753)
0928 13:07:01.495486 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:01.495488 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:01.495611 (+   123us) server_negotiation.cc:407] Connection header received
0928 13:07:01.495690 (+    79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:01.495690 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:01.495719 (+    29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:01.495787 (+    68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:01.496360 (+   573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:01.496877 (+   517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:01.497608 (+   731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:01.497822 (+   214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:01.497899 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:01.499242 (+  1343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:01.499243 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:01.499244 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:01.499251 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:01.500697 (+  1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:01.501079 (+   382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:01.501081 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:01.501081 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:01.501141 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:01.501340 (+   199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:01.501341 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:01.501341 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:01.501461 (+   120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:01.501563 (+   102us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:01.501681 (+   118us) server_negotiation.cc:299] Negotiation successful
0928 13:07:01.501758 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:07:01.508847 23696 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:01.509455 23696 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:01.511842 23696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 725671c521f84ef7a13537bf43fe9878: Generated new TSK 0
I20260928 13:07:01.512040 23696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:01.515798  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23614
2026-09-28T13:07:01Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1342 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23713](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23713](info): set up 2 sockets
Sep 28 13:07:01 dist-test-slave-ddvw krb5kdc[23713](info): commencing operation
krb5kdc: starting...
W20260928 13:07:02.550985  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.017s	user 0.002s	sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:02 dist-test-slave-ddvw krb5kdc[23713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:02.673550  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42593
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:02.754913 23726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:02.755214 23726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:02.755240 23726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:02.756542 23726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:02.756592 23726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:02.756608 23726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:02.756621 23726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:02.756633 23726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:02.758279 23726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42593
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:02.758539 23726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:02.758775 23726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:02.763649 23732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:02.763671 23731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:02.763655 23734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:02.764755 23726 server_base.cc:1034] running on GCE node
I20260928 13:07:02.765007 23726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:02.765265 23726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:02.766458 23726 hybrid_clock.cc:648] HybridClock initialized: now 1790600822766443 us; error 30 us; skew 500 ppm
Sep 28 13:07:02 dist-test-slave-ddvw krb5kdc[23713](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600822, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:02.775269 23726 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:02.775758 23726 webserver.cc:460] Webserver started at http://127.0.0.1:45307/ using document root <none> and password file <none>
I20260928 13:07:02.776031 23726 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:02.776106 23726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:02.776268 23726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:02.777441 23726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f"
format_stamp: "Formatted at 2026-09-28 13:07:02 on dist-test-slave-ddvw"
server_key: "a84bc4c4aa2ba1f947d6ebf34a635fdb"
server_key_iv: "7c1513738906e913cdf3c9a03be676a1"
server_key_version: "encryptionkey@0"
I20260928 13:07:02.777882 23726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f"
format_stamp: "Formatted at 2026-09-28 13:07:02 on dist-test-slave-ddvw"
server_key: "a84bc4c4aa2ba1f947d6ebf34a635fdb"
server_key_iv: "7c1513738906e913cdf3c9a03be676a1"
server_key_version: "encryptionkey@0"
I20260928 13:07:02.779383 23726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:07:02.780217 23741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:02.780396 23726 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:07:02.780515 23726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f"
format_stamp: "Formatted at 2026-09-28 13:07:02 on dist-test-slave-ddvw"
server_key: "a84bc4c4aa2ba1f947d6ebf34a635fdb"
server_key_iv: "7c1513738906e913cdf3c9a03be676a1"
server_key_version: "encryptionkey@0"
I20260928 13:07:02.780598 23726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:02.831475 23726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:02.834209 23726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:02.834398 23726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:02.839917 23726 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42593
I20260928 13:07:02.839985 23793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42593 every 8 connection(s)
I20260928 13:07:02.840402 23726 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:02.841498 23794 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:02.843782 23794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f: Bootstrap starting.
I20260928 13:07:02.844308 23794 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:02.844542 23794 log.cc:824] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:02.845239 23794 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f: No bootstrap required, opened a new log
I20260928 13:07:02.846793 23794 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } }
I20260928 13:07:02.846933 23794 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:02.846956 23794 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe7bdc8f3384fb98ce1cbe33b5b7f3f, State: Initialized, Role: FOLLOWER
I20260928 13:07:02.847141 23794 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } }
I20260928 13:07:02.847208 23794 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:02.847229 23794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:02.847257 23794 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:02.847747 23794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } }
I20260928 13:07:02.847826 23794 leader_election.cc:302] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7fe7bdc8f3384fb98ce1cbe33b5b7f3f; no voters: 
I20260928 13:07:02.847955 23794 leader_election.cc:288] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:02.848013 23797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:02.848203 23797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [term 1 LEADER]: Becoming Leader. State: Replica: 7fe7bdc8f3384fb98ce1cbe33b5b7f3f, State: Running, Role: LEADER
I20260928 13:07:02.848214 23794 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:02.848312 23797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } }
I20260928 13:07:02.848752 23798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } } }
I20260928 13:07:02.848784 23799 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7fe7bdc8f3384fb98ce1cbe33b5b7f3f. Latest consensus state: current_term: 1 leader_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7fe7bdc8f3384fb98ce1cbe33b5b7f3f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42593 } } }
I20260928 13:07:02.848909 23798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:02.849221  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23726
I20260928 13:07:02.848963 23799 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:02.849355  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:02.849531 23803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:02.849558  3096 external_mini_cluster.cc:1428] Setting key 8261eeee80018bd36dfcc1d9604975f1
I20260928 13:07:02.850066 23803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:02.855123 23815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:02.850073 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54705 (local address 127.0.0.1:42593)
0928 13:07:02.850805 (+   732us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:02.850812 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:02.850844 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:07:02.850931 (+    87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:02.850936 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:02.850978 (+    42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:02.851141 (+   163us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:02.851476 (+   335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:02.852383 (+   907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:02.853168 (+   785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:02.853590 (+   422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:02.853710 (+   120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:02.854450 (+   740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:02.854454 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:02.854454 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:02.854620 (+   166us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:02.854648 (+    28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:02.854659 (+    11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:02.854731 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:02.854827 (+    96us) server_negotiation.cc:299] Negotiation successful
0928 13:07:02.854903 (+    76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":83,"threads_started":1}
I20260928 13:07:02.855492 23803 catalog_manager.cc:1347] Generated new cluster ID: 1e70e5e2dfeb41b7910f6be37e24d736
I20260928 13:07:02.855545 23803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:02.856123  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:02.862867 23815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:02.857765 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56015 (local address 127.0.0.1:42593)
0928 13:07:02.859074 (+  1309us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:02.859077 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:02.859241 (+   164us) server_negotiation.cc:407] Connection header received
0928 13:07:02.859309 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:02.859310 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:02.859320 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:02.859372 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:02.859524 (+   152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:02.860232 (+   708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:02.861408 (+  1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:02.861700 (+   292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:02.861760 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:02.862529 (+   769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:02.862531 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:02.862531 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:02.862536 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:02.862551 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:02.862555 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:02.862607 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:02.862686 (+    79us) server_negotiation.cc:299] Negotiation successful
0928 13:07:02.862710 (+    24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1289}
I20260928 13:07:02.867808 23803 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:02.868597 23803 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:02.882897 23803 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7fe7bdc8f3384fb98ce1cbe33b5b7f3f: Generated new TSK 0
I20260928 13:07:02.883241 23803 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:02.893371  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23726
2026-09-28T13:07:02Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1378 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:02 dist-test-slave-ddvw krb5kdc[23825](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:02 dist-test-slave-ddvw krb5kdc[23825](info): set up 2 sockets
Sep 28 13:07:02 dist-test-slave-ddvw krb5kdc[23825](info): commencing operation
krb5kdc: starting...
W20260928 13:07:04.006996  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.095s	user 0.002s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:04 dist-test-slave-ddvw krb5kdc[23825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600824, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:04.129303  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37565
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:04.209535 23838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:04.209751 23838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:04.209775 23838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:04.210865 23838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:04.210901 23838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:04.210915 23838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:04.210927 23838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:04.210939 23838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:04.212527 23838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:04.212716 23838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:04.212881 23838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:04.217499 23846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:04.217626 23838 server_base.cc:1034] running on GCE node
W20260928 13:07:04.217579 23844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:04.217499 23843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:04.217979 23838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:04.218276 23838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:04.219457 23838 hybrid_clock.cc:648] HybridClock initialized: now 1790600824219442 us; error 45 us; skew 500 ppm
Sep 28 13:07:04 dist-test-slave-ddvw krb5kdc[23825](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600824, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:04.229066 23838 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:04.229496 23838 webserver.cc:460] Webserver started at http://127.0.0.1:39371/ using document root <none> and password file <none>
I20260928 13:07:04.229689 23838 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:04.229730 23838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:04.229820 23838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:04.230842 23838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "3784831133184b0b830ff451a0984de2"
format_stamp: "Formatted at 2026-09-28 13:07:04 on dist-test-slave-ddvw"
server_key: "d6c5d0ee952664ded61da3ea955db786"
server_key_iv: "3c9f403024674aa6c91d17ef553362c0"
server_key_version: "encryptionkey@0"
I20260928 13:07:04.231257 23838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "3784831133184b0b830ff451a0984de2"
format_stamp: "Formatted at 2026-09-28 13:07:04 on dist-test-slave-ddvw"
server_key: "d6c5d0ee952664ded61da3ea955db786"
server_key_iv: "3c9f403024674aa6c91d17ef553362c0"
server_key_version: "encryptionkey@0"
I20260928 13:07:04.232666 23838 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:04.233424 23853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:04.233723 23838 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:04.233876 23838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "3784831133184b0b830ff451a0984de2"
format_stamp: "Formatted at 2026-09-28 13:07:04 on dist-test-slave-ddvw"
server_key: "d6c5d0ee952664ded61da3ea955db786"
server_key_iv: "3c9f403024674aa6c91d17ef553362c0"
server_key_version: "encryptionkey@0"
I20260928 13:07:04.233958 23838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:04.237396 23838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:04.239468 23838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:04.239626 23838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:04.243556 23838 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37565
I20260928 13:07:04.243604 23905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37565 every 8 connection(s)
I20260928 13:07:04.243965 23838 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:04.244194  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23838
I20260928 13:07:04.244333  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:04.244513  3096 external_mini_cluster.cc:1428] Setting key fceffac4bf0c4ef4fc3789c0bf779dac
I20260928 13:07:04.244983 23906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:04.247094 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:04.245076 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52699 (local address 127.0.0.1:37565)
0928 13:07:04.245270 (+   194us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:04.245280 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:04.245315 (+    35us) server_negotiation.cc:407] Connection header received
0928 13:07:04.245737 (+   422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:04.245770 (+    33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:04.245796 (+    26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:04.245949 (+   153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:04.246635 (+   686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:04.246643 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:04.246643 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:04.246647 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:04.246680 (+    33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:04.246690 (+    10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:04.246779 (+    89us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:04.246851 (+    72us) server_negotiation.cc:299] Negotiation successful
0928 13:07:04.246892 (+    41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
I20260928 13:07:04.248054  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:04.248368 23906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2: Bootstrap starting.
I20260928 13:07:04.248945 23906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:04.249300 23906 log.cc:824] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:04.250589 23906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2: No bootstrap required, opened a new log
I20260928 13:07:04.250602 23909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:04.249454 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48839 (local address 127.0.0.1:37565)
0928 13:07:04.249488 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:04.249490 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:04.249607 (+   117us) server_negotiation.cc:407] Connection header received
0928 13:07:04.249684 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:04.249685 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:04.249691 (+     6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:04.249755 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:04.250388 (+   633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:04.250389 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:04.250390 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:04.250393 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:04.250405 (+    12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:04.250408 (+     3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:04.250455 (+    47us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:04.250511 (+    56us) server_negotiation.cc:299] Negotiation successful
0928 13:07:04.250521 (+    10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260928 13:07:04.252490 23906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } }
I20260928 13:07:04.252655 23906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:04.252701 23906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3784831133184b0b830ff451a0984de2, State: Initialized, Role: FOLLOWER
I20260928 13:07:04.252835 23906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } }
I20260928 13:07:04.252933 23906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:04.252975 23906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:04.253026 23906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:04.253567 23906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } }
I20260928 13:07:04.253684 23906 leader_election.cc:302] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3784831133184b0b830ff451a0984de2; no voters: 
I20260928 13:07:04.253882 23906 leader_election.cc:288] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:04.253916 23916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:04.254076 23916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [term 1 LEADER]: Becoming Leader. State: Replica: 3784831133184b0b830ff451a0984de2, State: Running, Role: LEADER
I20260928 13:07:04.254163 23906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:04.254176 23916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } }
I20260928 13:07:04.254576 23916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3784831133184b0b830ff451a0984de2. Latest consensus state: current_term: 1 leader_uuid: "3784831133184b0b830ff451a0984de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } } }
I20260928 13:07:04.254703 23916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:04.254662 23918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3784831133184b0b830ff451a0984de2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3784831133184b0b830ff451a0984de2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37565 } } }
I20260928 13:07:04.254858 23918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:04.255285 23925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:04.255779 23925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:04.257265 23925 catalog_manager.cc:1347] Generated new cluster ID: 934bf6475e194c258bb1061bca75327f
I20260928 13:07:04.257334 23925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:04.267580 23925 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:04.267786 23925 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:04.271996 23925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3784831133184b0b830ff451a0984de2: Generated new TSK 0
I20260928 13:07:04.272171 23925 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:04.283710  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23838
2026-09-28T13:07:04Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1389 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:04 dist-test-slave-ddvw krb5kdc[23937](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:04 dist-test-slave-ddvw krb5kdc[23937](info): set up 2 sockets
Sep 28 13:07:04 dist-test-slave-ddvw krb5kdc[23937](info): commencing operation
krb5kdc: starting...
W20260928 13:07:05.319295  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.017s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[23937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:05.437963  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:05.517642 23950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:05.517902 23950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:05.517943 23950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:05.519169 23950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:05.519241 23950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:05.519264 23950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:05.519285 23950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:05.519315 23950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:05.520862 23950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:05.521173 23950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:05.521411 23950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:05.526381 23956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:05.526554 23950 server_base.cc:1034] running on GCE node
W20260928 13:07:05.526397 23958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:05.526407 23955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:05.526921 23950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:05.527276 23950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:05.528429 23950 hybrid_clock.cc:648] HybridClock initialized: now 1790600825528416 us; error 30 us; skew 500 ppm
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[23937](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600825, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:05.531059 23950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:05.531481 23950 webserver.cc:460] Webserver started at http://127.0.0.1:43137/ using document root <none> and password file <none>
I20260928 13:07:05.531728 23950 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:05.531774 23950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:05.531900 23950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:05.533035 23950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "1d898bcd2b61434dafed5d0950d8a22f"
format_stamp: "Formatted at 2026-09-28 13:07:05 on dist-test-slave-ddvw"
server_key: "af99af5490177fe20b32dfb990a87ae0"
server_key_iv: "bc4c2dac3123031159f1c5d48f677111"
server_key_version: "encryptionkey@0"
I20260928 13:07:05.533383 23950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "1d898bcd2b61434dafed5d0950d8a22f"
format_stamp: "Formatted at 2026-09-28 13:07:05 on dist-test-slave-ddvw"
server_key: "af99af5490177fe20b32dfb990a87ae0"
server_key_iv: "bc4c2dac3123031159f1c5d48f677111"
server_key_version: "encryptionkey@0"
I20260928 13:07:05.534754 23950 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:05.535527 23965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:05.535708 23950 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:05.535816 23950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "1d898bcd2b61434dafed5d0950d8a22f"
format_stamp: "Formatted at 2026-09-28 13:07:05 on dist-test-slave-ddvw"
server_key: "af99af5490177fe20b32dfb990a87ae0"
server_key_iv: "bc4c2dac3123031159f1c5d48f677111"
server_key_version: "encryptionkey@0"
I20260928 13:07:05.535890 23950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:05.550716 23950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:05.553292 23950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:05.553452 23950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:05.557284 23950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43003
I20260928 13:07:05.557348 24017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43003 every 8 connection(s)
I20260928 13:07:05.557708 23950 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:05.558697 24018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:05.560937 24018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f: Bootstrap starting.
I20260928 13:07:05.561465 24018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:05.561691 24018 log.cc:824] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:05.562345 24018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f: No bootstrap required, opened a new log
I20260928 13:07:05.562659  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 23950
I20260928 13:07:05.562798  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:05.562964  3096 external_mini_cluster.cc:1428] Setting key 85b3857eba3d55c82118f593ba8250ca
I20260928 13:07:05.564307 24018 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } }
I20260928 13:07:05.564512 24018 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:05.564574 24018 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d898bcd2b61434dafed5d0950d8a22f, State: Initialized, Role: FOLLOWER
I20260928 13:07:05.564702 24018 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } }
I20260928 13:07:05.564796 24018 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:05.564829 24018 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:05.564881 24018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:05.565825 24018 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } }
I20260928 13:07:05.565945 24018 leader_election.cc:302] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d898bcd2b61434dafed5d0950d8a22f; no voters: 
I20260928 13:07:05.566128 24018 leader_election.cc:288] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:05.566155 24023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:05.566304 24023 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [term 1 LEADER]: Becoming Leader. State: Replica: 1d898bcd2b61434dafed5d0950d8a22f, State: Running, Role: LEADER
I20260928 13:07:05.566437 24018 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:05.566437 24023 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } }
I20260928 13:07:05.566923 24024 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d898bcd2b61434dafed5d0950d8a22f. Latest consensus state: current_term: 1 leader_uuid: "1d898bcd2b61434dafed5d0950d8a22f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } } }
I20260928 13:07:05.567101 24024 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:05.567296 24025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d898bcd2b61434dafed5d0950d8a22f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d898bcd2b61434dafed5d0950d8a22f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43003 } } }
I20260928 13:07:05.567401 24025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:05.567612 24032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:05.568133 24032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:05.569867 24032 catalog_manager.cc:1347] Generated new cluster ID: 1c18d3d1985240199ddea0c0df3467c1
I20260928 13:07:05.569918 24032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[23937](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600825, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 13:07:05.574726 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:05.563520 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:50559 (local address 127.0.0.1:43003)
0928 13:07:05.563708 (+   188us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:05.563716 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:05.563741 (+    25us) server_negotiation.cc:407] Connection header received
0928 13:07:05.564287 (+   546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:05.564293 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:05.564341 (+    48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:05.564452 (+   111us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:05.565266 (+   814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:05.566360 (+  1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:05.567448 (+  1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:05.568041 (+   593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:05.568144 (+   103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:05.570845 (+  2701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:05.570848 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:05.570849 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:05.570860 (+    11us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:05.572874 (+  2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:05.573300 (+   426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:05.573303 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:05.573303 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:05.573434 (+   131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:05.573668 (+   234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:05.573669 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:05.573669 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:05.573999 (+   330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:05.574175 (+   176us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:05.574259 (+    84us) server_negotiation.cc:299] Negotiation successful
0928 13:07:05.574360 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":71,"threads_started":1}
I20260928 13:07:05.575752  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:05.583843 24032 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:05.584575 24032 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:05.584729 24022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:05.577350 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:47521 (local address 127.0.0.1:43003)
0928 13:07:05.577382 (+    32us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:05.577384 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:05.577392 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:07:05.577458 (+    66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:05.577458 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:05.577467 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:05.577511 (+    44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:05.578145 (+   634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:05.578871 (+   726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:05.579931 (+  1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:05.580237 (+   306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:05.580294 (+    57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:05.581664 (+  1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:05.581665 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:05.581665 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:05.581672 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:05.583286 (+  1614us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:05.583915 (+   629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:05.583916 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:05.583917 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:05.583975 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:05.584228 (+   253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:05.584229 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:05.584229 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:05.584345 (+   116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:05.584460 (+   115us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:05.584591 (+   131us) server_negotiation.cc:299] Negotiation successful
0928 13:07:05.584656 (+    65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:07:05.590570 24032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d898bcd2b61434dafed5d0950d8a22f: Generated new TSK 0
I20260928 13:07:05.590762 24032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:05.595721  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 23950
W20260928 13:07:05.600248 23935 connection.cc:535] client connection to 127.0.0.1:43003 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43003): Connection reset by peer (error 104)
2026-09-28T13:07:05Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1311 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[24049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[24049](info): set up 2 sockets
Sep 28 13:07:05 dist-test-slave-ddvw krb5kdc[24049](info): commencing operation
krb5kdc: starting...
W20260928 13:07:06.627161  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.013s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:06 dist-test-slave-ddvw krb5kdc[24049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:06.746078  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:06.826892 24062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:06.827178 24062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:06.827220 24062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:06.828917 24062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:06.828977 24062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:06.829003 24062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:06.829023 24062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:06.829054 24062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:06.831422 24062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:06.831737 24062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:06.832013 24062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:06.836856 24067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:06.836937 24062 server_base.cc:1034] running on GCE node
W20260928 13:07:06.836858 24070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:06.836880 24068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:06.837392 24062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:06.837790 24062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:06.838960 24062 hybrid_clock.cc:648] HybridClock initialized: now 1790600826838949 us; error 42 us; skew 500 ppm
Sep 28 13:07:06 dist-test-slave-ddvw krb5kdc[24049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600826, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:06.841600 24062 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:06.842067 24062 webserver.cc:460] Webserver started at http://127.0.0.1:32785/ using document root <none> and password file <none>
I20260928 13:07:06.842330 24062 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:06.842401 24062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:06.842553 24062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:06.843734 24062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "c5493e408961409d9e6000bb9d99357c"
format_stamp: "Formatted at 2026-09-28 13:07:06 on dist-test-slave-ddvw"
server_key: "30efb0130e0de9887215751ca4ce83e2"
server_key_iv: "5c5c8216ac89ce64e452abe11346b8d3"
server_key_version: "encryptionkey@0"
I20260928 13:07:06.844099 24062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "c5493e408961409d9e6000bb9d99357c"
format_stamp: "Formatted at 2026-09-28 13:07:06 on dist-test-slave-ddvw"
server_key: "30efb0130e0de9887215751ca4ce83e2"
server_key_iv: "5c5c8216ac89ce64e452abe11346b8d3"
server_key_version: "encryptionkey@0"
I20260928 13:07:06.845454 24062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:07:06.846192 24077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:06.846367 24062 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:06.846472 24062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "c5493e408961409d9e6000bb9d99357c"
format_stamp: "Formatted at 2026-09-28 13:07:06 on dist-test-slave-ddvw"
server_key: "30efb0130e0de9887215751ca4ce83e2"
server_key_iv: "5c5c8216ac89ce64e452abe11346b8d3"
server_key_version: "encryptionkey@0"
I20260928 13:07:06.846551 24062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:06.856364 24062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:06.858162 24062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:06.858333 24062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:06.862612 24129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35687 every 8 connection(s)
I20260928 13:07:06.862789 24062 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35687
I20260928 13:07:06.863268 24062 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:06.864369 24130 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:06.866633 24130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c: Bootstrap starting.
I20260928 13:07:06.867264 24130 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:06.867524 24130 log.cc:824] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:06.868234 24130 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c: No bootstrap required, opened a new log
I20260928 13:07:06.869758 24130 raft_consensus.cc:348] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260928 13:07:06.869913 24130 raft_consensus.cc:374] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:06.869938 24130 raft_consensus.cc:729] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5493e408961409d9e6000bb9d99357c, State: Initialized, Role: FOLLOWER
I20260928 13:07:06.870083 24130 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260928 13:07:06.870173 24130 raft_consensus.cc:388] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:06.870196 24130 raft_consensus.cc:482] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:06.870225 24130 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:06.870710 24130 raft_consensus.cc:504] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260928 13:07:06.870796 24130 leader_election.cc:302] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5493e408961409d9e6000bb9d99357c; no voters: 
I20260928 13:07:06.870955  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24062
I20260928 13:07:06.871061 24133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:06.871099  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:06.871061 24130 leader_election.cc:288] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:06.871230 24133 raft_consensus.cc:686] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [term 1 LEADER]: Becoming Leader. State: Replica: c5493e408961409d9e6000bb9d99357c, State: Running, Role: LEADER
I20260928 13:07:06.871323  3096 external_mini_cluster.cc:1428] Setting key 1ac59a392427c3a2583f5f368ee4a9c8
I20260928 13:07:06.871397 24130 sys_catalog.cc:564] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:06.871372 24133 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260928 13:07:06.871714 24133 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5493e408961409d9e6000bb9d99357c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } } }
I20260928 13:07:06.871779 24133 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:06.871891 24134 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5493e408961409d9e6000bb9d99357c. Latest consensus state: current_term: 1 leader_uuid: "c5493e408961409d9e6000bb9d99357c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5493e408961409d9e6000bb9d99357c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } } }
I20260928 13:07:06.871973 24134 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:06.872627 24139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:06.873155 24139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:06.874796 24139 catalog_manager.cc:1347] Generated new cluster ID: 7f83a64ae2924b8eacb722e00abc545e
I20260928 13:07:06.874850 24139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:06.877477 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:06.871992 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:47667 (local address 127.0.0.1:35687)
0928 13:07:06.872372 (+   380us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:06.872382 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:06.872413 (+    31us) server_negotiation.cc:407] Connection header received
0928 13:07:06.872538 (+   125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:06.872546 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:06.872612 (+    66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:06.873086 (+   474us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:06.873189 (+   103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:06.874429 (+  1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:06.875418 (+   989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:06.875846 (+   428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:06.875983 (+   137us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:06.876772 (+   789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:06.876776 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:06.876776 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:06.876957 (+   181us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:06.876988 (+    31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:06.876999 (+    11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:06.877096 (+    97us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:06.877187 (+    91us) server_negotiation.cc:299] Negotiation successful
0928 13:07:06.877307 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":89,"threads_started":1}
I20260928 13:07:06.879878  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:06.884328 24144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:06.881288 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:57619 (local address 127.0.0.1:35687)
0928 13:07:06.881393 (+   105us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:06.881394 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:06.881443 (+    49us) server_negotiation.cc:407] Connection header received
0928 13:07:06.881515 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:06.881516 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:06.881527 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:06.881579 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:06.881713 (+   134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:06.882196 (+   483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:06.882918 (+   722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:06.883241 (+   323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:06.883328 (+    87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:06.884070 (+   742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:06.884072 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:06.884072 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:06.884077 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:06.884103 (+    26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:06.884107 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:06.884180 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:06.884242 (+    62us) server_negotiation.cc:299] Negotiation successful
0928 13:07:06.884254 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260928 13:07:06.889313 24139 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:06.889849 24139 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:06.901858 24139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c5493e408961409d9e6000bb9d99357c: Generated new TSK 0
I20260928 13:07:06.902114 24139 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:06.910125  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24062
W20260928 13:07:06.914115 24047 connection.cc:535] client connection to 127.0.0.1:35687 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35687): Connection reset by peer (error 104)
2026-09-28T13:07:06Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1313 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:06 dist-test-slave-ddvw krb5kdc[24161](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:06 dist-test-slave-ddvw krb5kdc[24161](info): set up 2 sockets
Sep 28 13:07:06 dist-test-slave-ddvw krb5kdc[24161](info): commencing operation
krb5kdc: starting...
W20260928 13:07:07.939093  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.011s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:08 dist-test-slave-ddvw krb5kdc[24161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600828, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:08.056339  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38851
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37931
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:08.138164 24174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:08.138469 24174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:08.138520 24174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:08.139780 24174 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:08.139859 24174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:08.139883 24174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:08.139914 24174 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:08.139945 24174 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:08.141602 24174 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37931
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:08.141897 24174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:08.142135 24174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:08.147222 24179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:08.147238 24180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:08.147441 24174 server_base.cc:1034] running on GCE node
W20260928 13:07:08.147244 24182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:08.147764 24174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:08.148072 24174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:08.149253 24174 hybrid_clock.cc:648] HybridClock initialized: now 1790600828149250 us; error 37 us; skew 500 ppm
Sep 28 13:07:08 dist-test-slave-ddvw krb5kdc[24161](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600828, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:08.151890 24174 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:08.152324 24174 webserver.cc:460] Webserver started at http://127.0.0.1:37583/ using document root <none> and password file <none>
I20260928 13:07:08.152575 24174 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:08.152643 24174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:08.152786 24174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:08.153872 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "a79705c44fde4790924b88adb254f75f"
format_stamp: "Formatted at 2026-09-28 13:07:08 on dist-test-slave-ddvw"
server_key: "0fefed3bbe8a2151f5192e5fd4bca747"
server_key_iv: "f8bde5a506fe20231847748c197c4555"
server_key_version: "encryptionkey@0"
I20260928 13:07:08.154233 24174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "a79705c44fde4790924b88adb254f75f"
format_stamp: "Formatted at 2026-09-28 13:07:08 on dist-test-slave-ddvw"
server_key: "0fefed3bbe8a2151f5192e5fd4bca747"
server_key_iv: "f8bde5a506fe20231847748c197c4555"
server_key_version: "encryptionkey@0"
I20260928 13:07:08.155637 24174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.002s
I20260928 13:07:08.156435 24189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:08.156651 24174 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:08.156766 24174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "a79705c44fde4790924b88adb254f75f"
format_stamp: "Formatted at 2026-09-28 13:07:08 on dist-test-slave-ddvw"
server_key: "0fefed3bbe8a2151f5192e5fd4bca747"
server_key_iv: "f8bde5a506fe20231847748c197c4555"
server_key_version: "encryptionkey@0"
I20260928 13:07:08.156842 24174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:08.160324 24174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:08.162290 24174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:08.162446 24174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:08.166515 24174 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38851
I20260928 13:07:08.166564 24241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38851 every 8 connection(s)
I20260928 13:07:08.166913 24174 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:08.167917 24242 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:08.170121 24242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: Bootstrap starting.
I20260928 13:07:08.170692 24242 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:08.170977 24242 log.cc:824] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:08.171232  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24174
I20260928 13:07:08.171377  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:08.171558  3096 external_mini_cluster.cc:1428] Setting key 25c5c71194a00b7bdf330475fe968d6d
I20260928 13:07:08.171830 24242 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: No bootstrap required, opened a new log
I20260928 13:07:08.173635 24242 raft_consensus.cc:348] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260928 13:07:08.173810 24242 raft_consensus.cc:374] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:08.173847 24242 raft_consensus.cc:729] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a79705c44fde4790924b88adb254f75f, State: Initialized, Role: FOLLOWER
I20260928 13:07:08.174018 24242 consensus_queue.cc:260] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260928 13:07:08.174129 24242 raft_consensus.cc:388] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:08.174162 24242 raft_consensus.cc:482] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:08.174203 24242 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:08.175149 24246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:08.172209 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:50513 (local address 127.0.0.1:38851)
0928 13:07:08.172375 (+   166us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:08.172384 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:08.172420 (+    36us) server_negotiation.cc:407] Connection header received
0928 13:07:08.173616 (+  1196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:08.173624 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:08.173656 (+    32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:08.173790 (+   134us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:08.174595 (+   805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:08.174599 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:08.174599 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:08.174602 (+     3us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:08.174637 (+    35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:08.174647 (+    10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:08.174706 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:08.174806 (+   100us) server_negotiation.cc:299] Negotiation successful
0928 13:07:08.174863 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260928 13:07:08.175452 24242 raft_consensus.cc:504] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260928 13:07:08.175585 24242 leader_election.cc:302] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a79705c44fde4790924b88adb254f75f; no voters: 
I20260928 13:07:08.175746 24242 leader_election.cc:288] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:08.175798 24247 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:08.175940 24247 raft_consensus.cc:686] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [term 1 LEADER]: Becoming Leader. State: Replica: a79705c44fde4790924b88adb254f75f, State: Running, Role: LEADER
I20260928 13:07:08.176043 24242 sys_catalog.cc:564] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:08.176041 24247 consensus_queue.cc:237] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } }
I20260928 13:07:08.176191  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:08.176700 24248 sys_catalog.cc:455] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a79705c44fde4790924b88adb254f75f. Latest consensus state: current_term: 1 leader_uuid: "a79705c44fde4790924b88adb254f75f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } } }
I20260928 13:07:08.176777 24248 sys_catalog.cc:458] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:08.177891 24249 sys_catalog.cc:455] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a79705c44fde4790924b88adb254f75f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a79705c44fde4790924b88adb254f75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38851 } } }
I20260928 13:07:08.177984 24249 sys_catalog.cc:458] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f [sys.catalog]: This master's current role is: LEADER
W20260928 13:07:08.178045 24267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:08.178095 24267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:08.178471 24255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:08.178673 24255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:08.179422 24246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:08.178217 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:56525 (local address 127.0.0.1:38851)
0928 13:07:08.178246 (+    29us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:08.178248 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:08.178391 (+   143us) server_negotiation.cc:407] Connection header received
0928 13:07:08.178468 (+    77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:08.178469 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:08.178474 (+     5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:08.178526 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:08.179185 (+   659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:08.179187 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:08.179187 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:08.179191 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:08.179205 (+    14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:08.179209 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:08.179288 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:08.179351 (+    63us) server_negotiation.cc:299] Negotiation successful
0928 13:07:08.179367 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13}
I20260928 13:07:08.180253 24255 catalog_manager.cc:1347] Generated new cluster ID: 67a552d36fa54dca94680fc7f0886984
I20260928 13:07:08.180308 24255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:08.187994 24255 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:08.188146 24255 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:08.197386 24255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a79705c44fde4790924b88adb254f75f: Generated new TSK 0
I20260928 13:07:08.197575 24255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:08.199122  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24174
2026-09-28T13:07:08Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1289 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:08 dist-test-slave-ddvw krb5kdc[24273](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:08 dist-test-slave-ddvw krb5kdc[24273](info): set up 2 sockets
Sep 28 13:07:08 dist-test-slave-ddvw krb5kdc[24273](info): commencing operation
krb5kdc: starting...
W20260928 13:07:09.227080  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.010s	user 0.001s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:09.346751  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38293
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:09.425985 24286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:09.426258 24286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:09.426296 24286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:09.427541 24286 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:09.427619 24286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:09.427642 24286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:09.427664 24286 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:09.427695 24286 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:09.429191 24286 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38293
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:09.429481 24286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:09.429713 24286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:09.434612 24294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:09.434612 24291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:09.434697 24292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:09.434734 24286 server_base.cc:1034] running on GCE node
I20260928 13:07:09.435130 24286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:09.435426 24286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:09.436594 24286 hybrid_clock.cc:648] HybridClock initialized: now 1790600829436567 us; error 41 us; skew 500 ppm
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24273](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600829, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:09.445346 24286 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:09.445914 24286 webserver.cc:460] Webserver started at http://127.0.0.1:40721/ using document root <none> and password file <none>
I20260928 13:07:09.446157 24286 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:09.446225 24286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:09.446378 24286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:09.447567 24286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "f0095cda84ce445a9c650f4c0548367b"
format_stamp: "Formatted at 2026-09-28 13:07:09 on dist-test-slave-ddvw"
server_key: "114e225f359ac58cc202f1b9fd2e5456"
server_key_iv: "65c1ac86bb382a36a43b265cf05fd1bf"
server_key_version: "encryptionkey@0"
I20260928 13:07:09.447932 24286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "f0095cda84ce445a9c650f4c0548367b"
format_stamp: "Formatted at 2026-09-28 13:07:09 on dist-test-slave-ddvw"
server_key: "114e225f359ac58cc202f1b9fd2e5456"
server_key_iv: "65c1ac86bb382a36a43b265cf05fd1bf"
server_key_version: "encryptionkey@0"
I20260928 13:07:09.449306 24286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:07:09.450086 24301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:09.450274 24286 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:09.450380 24286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "f0095cda84ce445a9c650f4c0548367b"
format_stamp: "Formatted at 2026-09-28 13:07:09 on dist-test-slave-ddvw"
server_key: "114e225f359ac58cc202f1b9fd2e5456"
server_key_iv: "65c1ac86bb382a36a43b265cf05fd1bf"
server_key_version: "encryptionkey@0"
I20260928 13:07:09.450453 24286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:09.474198 24286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:09.476205 24286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:09.476370 24286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:09.480417 24286 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38293
I20260928 13:07:09.480474 24353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38293 every 8 connection(s)
I20260928 13:07:09.480876 24286 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:09.481601  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24286
I20260928 13:07:09.481721  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:09.481909  3096 external_mini_cluster.cc:1428] Setting key 3b6408751fb0efa6e828db93d7047e7c
I20260928 13:07:09.482007 24354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:09.485417 24354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b: Bootstrap starting.
I20260928 13:07:09.486115 24354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:09.486446 24354 log.cc:824] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:09.487191 24354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b: No bootstrap required, opened a new log
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24273](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 13:07:09.489383 24354 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } }
I20260928 13:07:09.489557 24354 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:09.489584 24354 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0095cda84ce445a9c650f4c0548367b, State: Initialized, Role: FOLLOWER
I20260928 13:07:09.489748 24354 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } }
I20260928 13:07:09.489832 24354 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:09.489867 24354 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:09.489920 24354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:09.490471 24354 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } }
I20260928 13:07:09.490593 24354 leader_election.cc:302] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0095cda84ce445a9c650f4c0548367b; no voters: 
I20260928 13:07:09.490806 24354 leader_election.cc:288] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:09.490841 24359 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:09.490947 24359 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [term 1 LEADER]: Becoming Leader. State: Replica: f0095cda84ce445a9c650f4c0548367b, State: Running, Role: LEADER
I20260928 13:07:09.491102 24354 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:09.491101 24359 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } }
I20260928 13:07:09.491523 24359 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0095cda84ce445a9c650f4c0548367b. Latest consensus state: current_term: 1 leader_uuid: "f0095cda84ce445a9c650f4c0548367b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } } }
I20260928 13:07:09.491758 24359 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:09.491678 24361 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0095cda84ce445a9c650f4c0548367b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0095cda84ce445a9c650f4c0548367b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38293 } } }
I20260928 13:07:09.492166 24361 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:09.492383 24368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:09.493053 24368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:09.493374 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:09.482421 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:40325 (local address 127.0.0.1:38293)
0928 13:07:09.482603 (+   182us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:09.482612 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:09.482646 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:07:09.483143 (+   497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:09.483150 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:09.483201 (+    51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:09.483312 (+   111us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:09.484183 (+   871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:09.485032 (+   849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:09.486123 (+  1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:09.486630 (+   507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:09.486761 (+   131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:09.489468 (+  2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:09.489472 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:09.489473 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:09.489483 (+    10us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:09.491562 (+  2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:09.492025 (+   463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:09.492027 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:09.492027 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:09.492160 (+   133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:09.492408 (+   248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:09.492409 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:09.492410 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:09.492747 (+   337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:09.492938 (+   191us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:09.493062 (+   124us) server_negotiation.cc:299] Negotiation successful
0928 13:07:09.493163 (+   101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":111,"threads_started":1}
I20260928 13:07:09.494428  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:09.494884 24368 catalog_manager.cc:1347] Generated new cluster ID: 37f1f58a5da4422b8788586867ccbbf5
I20260928 13:07:09.494941 24368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:09.502249 24368 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:09.502924 24368 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:09.508167 24357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:09.495941 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:38999 (local address 127.0.0.1:38293)
0928 13:07:09.495978 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:09.495980 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:09.502030 (+  6050us) server_negotiation.cc:407] Connection header received
0928 13:07:09.502132 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:09.502134 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:09.502145 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:09.502202 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:09.502799 (+   597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:09.503368 (+   569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:09.504061 (+   693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:09.504265 (+   204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:09.504381 (+   116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:09.505548 (+  1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:09.505550 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:09.505550 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:09.505557 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:09.506951 (+  1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:09.507345 (+   394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:09.507346 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:09.507346 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:09.507415 (+    69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:09.507638 (+   223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:09.507639 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:09.507639 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:09.507753 (+   114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:09.507859 (+   106us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:09.507979 (+   120us) server_negotiation.cc:299] Negotiation successful
0928 13:07:09.508053 (+    74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:07:09.510277 24368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0095cda84ce445a9c650f4c0548367b: Generated new TSK 0
I20260928 13:07:09.510439 24368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:09.515766  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24286
W20260928 13:07:09.519639 24271 connection.cc:535] client connection to 127.0.0.1:38293 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38293): Connection reset by peer (error 104)
2026-09-28T13:07:09Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1315 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24385](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24385](info): set up 2 sockets
Sep 28 13:07:09 dist-test-slave-ddvw krb5kdc[24385](info): commencing operation
krb5kdc: starting...
W20260928 13:07:10.555229  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.022s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:10 dist-test-slave-ddvw krb5kdc[24385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:10.674697  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:10.755956 24398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:10.756188 24398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:10.756230 24398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:10.757498 24398 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:10.757560 24398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:10.757584 24398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:10.757618 24398 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:10.757647 24398 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:10.759199 24398 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44233
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:10.759536 24398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:10.759770 24398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:10.764858 24403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:10.764991 24398 server_base.cc:1034] running on GCE node
W20260928 13:07:10.764851 24406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:10.764926 24404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:10.765341 24398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:10.765637 24398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:10.766808 24398 hybrid_clock.cc:648] HybridClock initialized: now 1790600830766793 us; error 55 us; skew 500 ppm
Sep 28 13:07:10 dist-test-slave-ddvw krb5kdc[24385](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600830, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:10.769395 24398 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:10.769876 24398 webserver.cc:460] Webserver started at http://127.0.0.1:39873/ using document root <none> and password file <none>
I20260928 13:07:10.770103 24398 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:10.770170 24398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:10.770318 24398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:10.771448 24398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "a51318bff4ce4dffb6d31eb15072f88c"
format_stamp: "Formatted at 2026-09-28 13:07:10 on dist-test-slave-ddvw"
server_key: "af8ffafe334b944c863640044214da5f"
server_key_iv: "80b544e1874d2b71eba9dd89fe5c6c54"
server_key_version: "encryptionkey@0"
I20260928 13:07:10.771817 24398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "a51318bff4ce4dffb6d31eb15072f88c"
format_stamp: "Formatted at 2026-09-28 13:07:10 on dist-test-slave-ddvw"
server_key: "af8ffafe334b944c863640044214da5f"
server_key_iv: "80b544e1874d2b71eba9dd89fe5c6c54"
server_key_version: "encryptionkey@0"
I20260928 13:07:10.773128 24398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:07:10.773867 24413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:10.774034 24398 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:10.774138 24398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "a51318bff4ce4dffb6d31eb15072f88c"
format_stamp: "Formatted at 2026-09-28 13:07:10 on dist-test-slave-ddvw"
server_key: "af8ffafe334b944c863640044214da5f"
server_key_iv: "80b544e1874d2b71eba9dd89fe5c6c54"
server_key_version: "encryptionkey@0"
I20260928 13:07:10.774210 24398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:10.784106 24398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:10.785944 24398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:10.786105 24398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:10.790318 24398 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44233
I20260928 13:07:10.790832 24398 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:10.790886 24465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44233 every 8 connection(s)
I20260928 13:07:10.791671 24466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:10.793824 24466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c: Bootstrap starting.
I20260928 13:07:10.794345 24466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:10.794574 24466 log.cc:824] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:10.795287 24466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c: No bootstrap required, opened a new log
I20260928 13:07:10.796784 24466 raft_consensus.cc:348] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260928 13:07:10.797155 24466 raft_consensus.cc:374] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:10.797221 24466 raft_consensus.cc:729] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51318bff4ce4dffb6d31eb15072f88c, State: Initialized, Role: FOLLOWER
I20260928 13:07:10.797338 24466 consensus_queue.cc:260] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260928 13:07:10.797417 24466 raft_consensus.cc:388] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:10.797438 24466 raft_consensus.cc:482] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:10.797468 24466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:10.797958 24466 raft_consensus.cc:504] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260928 13:07:10.798041 24466 leader_election.cc:302] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a51318bff4ce4dffb6d31eb15072f88c; no voters: 
I20260928 13:07:10.798164 24466 leader_election.cc:288] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:10.798244 24469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:10.798462 24469 raft_consensus.cc:686] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [term 1 LEADER]: Becoming Leader. State: Replica: a51318bff4ce4dffb6d31eb15072f88c, State: Running, Role: LEADER
I20260928 13:07:10.798525 24466 sys_catalog.cc:564] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:10.798563 24469 consensus_queue.cc:237] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } }
I20260928 13:07:10.798928 24471 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a51318bff4ce4dffb6d31eb15072f88c. Latest consensus state: current_term: 1 leader_uuid: "a51318bff4ce4dffb6d31eb15072f88c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260928 13:07:10.799080 24471 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:10.799325  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24398
I20260928 13:07:10.799464  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:10.799672  3096 external_mini_cluster.cc:1428] Setting key 85a5d0d41961be66ac1c6a2e683ef075
I20260928 13:07:10.799132 24470 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a51318bff4ce4dffb6d31eb15072f88c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a51318bff4ce4dffb6d31eb15072f88c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44233 } } }
I20260928 13:07:10.799716 24470 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:10.800004 24480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:10.800599 24480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:10.802955 24480 catalog_manager.cc:1347] Generated new cluster ID: 6aeca72c31b14923902106357762ea85
I20260928 13:07:10.803025 24480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:10.805871 24487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:10.800328 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:53093 (local address 127.0.0.1:44233)
0928 13:07:10.800491 (+   163us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:10.800501 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:10.800533 (+    32us) server_negotiation.cc:407] Connection header received
0928 13:07:10.800651 (+   118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:10.800657 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:10.800713 (+    56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:10.800854 (+   141us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:10.801105 (+   251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:10.802467 (+  1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:10.803584 (+  1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:10.804224 (+   640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:10.804338 (+   114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:10.805153 (+   815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:10.805157 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:10.805158 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:10.805374 (+   216us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:10.805414 (+    40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:10.805430 (+    16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:10.805517 (+    87us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:10.805607 (+    90us) server_negotiation.cc:299] Negotiation successful
0928 13:07:10.805640 (+    33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260928 13:07:10.806984  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:10.812007 24487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:10.808435 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:41781 (local address 127.0.0.1:44233)
0928 13:07:10.808485 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:10.808488 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:10.808695 (+   207us) server_negotiation.cc:407] Connection header received
0928 13:07:10.808732 (+    37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:10.808733 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:10.808744 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:10.808813 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:10.808923 (+   110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:10.809680 (+   757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:10.810642 (+   962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:10.810967 (+   325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:10.811068 (+   101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:10.811745 (+   677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:10.811746 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:10.811746 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:10.811750 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:10.811765 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:10.811770 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:10.811834 (+    64us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:10.811911 (+    77us) server_negotiation.cc:299] Negotiation successful
0928 13:07:10.811923 (+    12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 13:07:10.828711 24480 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:10.829473 24480 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:10.832370 24480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a51318bff4ce4dffb6d31eb15072f88c: Generated new TSK 0
I20260928 13:07:10.832581 24480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:10.839718  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24398
W20260928 13:07:10.844156 24383 connection.cc:535] client connection to 127.0.0.1:44233 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44233): Connection reset by peer (error 104)
2026-09-28T13:07:10Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1324 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:10 dist-test-slave-ddvw krb5kdc[24497](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:10 dist-test-slave-ddvw krb5kdc[24497](info): set up 2 sockets
Sep 28 13:07:10 dist-test-slave-ddvw krb5kdc[24497](info): commencing operation
krb5kdc: starting...
W20260928 13:07:11.875284  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.017s	user 0.003s	sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:11 dist-test-slave-ddvw krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600831, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 13:07:11.995167  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46309
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46309
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:12.075423 24510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:12.075630 24510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:12.075654 24510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:12.076745 24510 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:12.076784 24510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:12.076799 24510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:12.076812 24510 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:12.076824 24510 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:12.078256 24510 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46309
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46309
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:12.078446 24510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:12.078613 24510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:12.083367 24518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:12.083402 24516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:12.083372 24515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:12.083951 24510 server_base.cc:1034] running on GCE node
I20260928 13:07:12.084213 24510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:12.084540 24510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:12.085716 24510 hybrid_clock.cc:648] HybridClock initialized: now 1790600832085695 us; error 54 us; skew 500 ppm
Sep 28 13:07:12 dist-test-slave-ddvw krb5kdc[24497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600832, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:12.088343 24510 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 13:07:12.088845 24510 webserver.cc:460] Webserver started at http://127.0.0.1:40107/ using document root <none> and password file <none>
I20260928 13:07:12.089102 24510 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:12.089171 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:12.089325 24510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:12.090447 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "c25b851d32c04311805edb258a14daa5"
format_stamp: "Formatted at 2026-09-28 13:07:12 on dist-test-slave-ddvw"
server_key: "baf1f463aaa2115590b840f26d8b19a3"
server_key_iv: "c5f406777c2544012ccbe22f233be5b1"
server_key_version: "encryptionkey@0"
I20260928 13:07:12.090821 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "c25b851d32c04311805edb258a14daa5"
format_stamp: "Formatted at 2026-09-28 13:07:12 on dist-test-slave-ddvw"
server_key: "baf1f463aaa2115590b840f26d8b19a3"
server_key_iv: "c5f406777c2544012ccbe22f233be5b1"
server_key_version: "encryptionkey@0"
I20260928 13:07:12.092229 24510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:12.093067 24525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:12.093251 24510 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:12.093345 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "c25b851d32c04311805edb258a14daa5"
format_stamp: "Formatted at 2026-09-28 13:07:12 on dist-test-slave-ddvw"
server_key: "baf1f463aaa2115590b840f26d8b19a3"
server_key_iv: "c5f406777c2544012ccbe22f233be5b1"
server_key_version: "encryptionkey@0"
I20260928 13:07:12.093462 24510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:12.096859 24510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:12.098819 24510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:12.099049 24510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:12.102897 24510 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46309
I20260928 13:07:12.102962 24577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46309 every 8 connection(s)
I20260928 13:07:12.103325 24510 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:12.104396 24578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:12.106766 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5: Bootstrap starting.
I20260928 13:07:12.107450 24578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:12.107751 24578 log.cc:824] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:12.108492 24578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5: No bootstrap required, opened a new log
I20260928 13:07:12.109952  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24510
I20260928 13:07:12.110081  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:12.110291  3096 external_mini_cluster.cc:1428] Setting key 90dbde4980883b7fba926ad847a13389
I20260928 13:07:12.110581 24578 raft_consensus.cc:348] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } }
I20260928 13:07:12.110747 24578 raft_consensus.cc:374] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:12.110841 24578 raft_consensus.cc:729] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c25b851d32c04311805edb258a14daa5, State: Initialized, Role: FOLLOWER
I20260928 13:07:12.111053 24578 consensus_queue.cc:260] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } }
I20260928 13:07:12.111155 24578 raft_consensus.cc:388] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:12.111189 24578 raft_consensus.cc:482] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:12.111245 24578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:12.112461 24578 raft_consensus.cc:504] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } }
I20260928 13:07:12.112551 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:12.110852 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:47327 (local address 127.0.0.1:46309)
0928 13:07:12.111076 (+   224us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:12.111086 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:12.111121 (+    35us) server_negotiation.cc:407] Connection header received
0928 13:07:12.111244 (+   123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:12.111252 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:12.111286 (+    34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:12.111455 (+   169us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:12.112084 (+   629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:12.112089 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:12.112089 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:12.112093 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:12.112139 (+    46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:12.112156 (+    17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:12.112245 (+    89us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:12.112278 (+    33us) server_negotiation.cc:299] Negotiation successful
0928 13:07:12.112325 (+    47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":86,"threads_started":1}
I20260928 13:07:12.112571 24578 leader_election.cc:302] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c25b851d32c04311805edb258a14daa5; no voters: 
I20260928 13:07:12.112731 24578 leader_election.cc:288] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:12.112792 24583 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:12.112979 24578 sys_catalog.cc:564] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:12.113485  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:12.112975 24583 raft_consensus.cc:686] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [term 1 LEADER]: Becoming Leader. State: Replica: c25b851d32c04311805edb258a14daa5, State: Running, Role: LEADER
I20260928 13:07:12.113600 24583 consensus_queue.cc:237] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } }
I20260928 13:07:12.114210 24584 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c25b851d32c04311805edb258a14daa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } } }
I20260928 13:07:12.114334 24584 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:12.114748 24585 sys_catalog.cc:455] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c25b851d32c04311805edb258a14daa5. Latest consensus state: current_term: 1 leader_uuid: "c25b851d32c04311805edb258a14daa5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c25b851d32c04311805edb258a14daa5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46309 } } }
I20260928 13:07:12.114835 24585 sys_catalog.cc:458] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:12.115028 24599 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:12.115769 24599 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:12.116354 24582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:12.115121 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.67:59745 (local address 127.0.0.1:46309)
0928 13:07:12.115159 (+    38us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:12.115161 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:12.115316 (+   155us) server_negotiation.cc:407] Connection header received
0928 13:07:12.115391 (+    75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:12.115392 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:12.115397 (+     5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:12.115474 (+    77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:12.116127 (+   653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:12.116128 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:12.116129 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:12.116133 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:12.116150 (+    17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:12.116155 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:12.116222 (+    67us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:12.116279 (+    57us) server_negotiation.cc:299] Negotiation successful
0928 13:07:12.116292 (+    13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:07:12.117571 24599 catalog_manager.cc:1347] Generated new cluster ID: 25d4065a27a74a77b0e091f16da43add
I20260928 13:07:12.117624 24599 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:12.134486 24599 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:12.134678 24599 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:12.141029 24599 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c25b851d32c04311805edb258a14daa5: Generated new TSK 0
I20260928 13:07:12.141213 24599 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:12.150396  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24510
2026-09-28T13:07:12Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1310 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:12 dist-test-slave-ddvw krb5kdc[24610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:12 dist-test-slave-ddvw krb5kdc[24610](info): set up 2 sockets
Sep 28 13:07:12 dist-test-slave-ddvw krb5kdc[24610](info): commencing operation
krb5kdc: starting...
W20260928 13:07:13.191001  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.023s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:13.308252  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34717
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:38031
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:34717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:13.389570 24623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:13.389766 24623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:13.389788 24623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:13.390950 24623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:13.390993 24623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:13.391032 24623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:13.391045 24623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:13.391099 24623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:13.392632 24623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:38031
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:34717
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:13.392874 24623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:13.393117 24623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:13.397943 24631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:13.397989 24628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:13.397943 24629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:13.398142 24623 server_base.cc:1034] running on GCE node
I20260928 13:07:13.398492 24623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:13.398829 24623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:13.400019 24623 hybrid_clock.cc:648] HybridClock initialized: now 1790600833399993 us; error 41 us; skew 500 ppm
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600833, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:13.402870 24623 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:13.403419 24623 webserver.cc:460] Webserver started at http://127.3.6.62:36163/ using document root <none> and password file <none>
I20260928 13:07:13.403688 24623 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:13.403766 24623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:13.403935 24623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:13.405088 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "d8fe4f193ee34de5976fe8e1978fe1bc"
format_stamp: "Formatted at 2026-09-28 13:07:13 on dist-test-slave-ddvw"
server_key: "2b9e2eb28ad75a898facc3a29a3efd98"
server_key_iv: "13ba871474f2e071f49adb1ddc3a8692"
server_key_version: "encryptionkey@0"
I20260928 13:07:13.405489 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "d8fe4f193ee34de5976fe8e1978fe1bc"
format_stamp: "Formatted at 2026-09-28 13:07:13 on dist-test-slave-ddvw"
server_key: "2b9e2eb28ad75a898facc3a29a3efd98"
server_key_iv: "13ba871474f2e071f49adb1ddc3a8692"
server_key_version: "encryptionkey@0"
I20260928 13:07:13.406927 24623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:07:13.407792 24638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:13.407989 24623 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:13.408107 24623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "d8fe4f193ee34de5976fe8e1978fe1bc"
format_stamp: "Formatted at 2026-09-28 13:07:13 on dist-test-slave-ddvw"
server_key: "2b9e2eb28ad75a898facc3a29a3efd98"
server_key_iv: "13ba871474f2e071f49adb1ddc3a8692"
server_key_version: "encryptionkey@0"
I20260928 13:07:13.408191 24623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:13.425024 24623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:13.427516 24623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:13.427685 24623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:13.431568 24623 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:34717
I20260928 13:07:13.431622 24690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:34717 every 8 connection(s)
I20260928 13:07:13.432011 24623 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:13.432929 24691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:13.432986  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24623
I20260928 13:07:13.433102  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:13.433350  3096 external_mini_cluster.cc:1428] Setting key 01b40498a0fd70a3a586e988b014d7b2
I20260928 13:07:13.436309 24691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: Bootstrap starting.
I20260928 13:07:13.437040 24691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:13.437336 24691 log.cc:824] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:13.438110 24691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: No bootstrap required, opened a new log
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:13.440758 24691 raft_consensus.cc:348] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } }
I20260928 13:07:13.440896 24691 raft_consensus.cc:374] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:13.440920 24691 raft_consensus.cc:729] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8fe4f193ee34de5976fe8e1978fe1bc, State: Initialized, Role: FOLLOWER
I20260928 13:07:13.441071 24691 consensus_queue.cc:260] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } }
I20260928 13:07:13.441166 24691 raft_consensus.cc:388] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:13.441200 24691 raft_consensus.cc:482] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:13.441253 24691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:13.442024 24691 raft_consensus.cc:504] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } }
I20260928 13:07:13.442164 24691 leader_election.cc:302] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d8fe4f193ee34de5976fe8e1978fe1bc; no voters: 
I20260928 13:07:13.442337 24691 leader_election.cc:288] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:13.442382 24696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:13.442494 24696 raft_consensus.cc:686] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [term 1 LEADER]: Becoming Leader. State: Replica: d8fe4f193ee34de5976fe8e1978fe1bc, State: Running, Role: LEADER
I20260928 13:07:13.442634 24691 sys_catalog.cc:564] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:13.442639 24696 consensus_queue.cc:237] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } }
I20260928 13:07:13.442974 24696 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader d8fe4f193ee34de5976fe8e1978fe1bc. Latest consensus state: current_term: 1 leader_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } } }
I20260928 13:07:13.442991 24697 sys_catalog.cc:455] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d8fe4f193ee34de5976fe8e1978fe1bc" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34717 } } }
I20260928 13:07:13.443130 24696 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:13.443200 24697 sys_catalog.cc:458] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc [sys.catalog]: This master's current role is: LEADER
W20260928 13:07:13.444413 24711 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:13.444471 24711 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:13.444581 24705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:13.444752 24705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:13.445282 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:13.433902 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40839 (local address 127.3.6.62:34717)
0928 13:07:13.434072 (+   170us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:13.434082 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:13.434116 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:07:13.434543 (+   427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:13.434550 (+     7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:13.434596 (+    46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:13.434709 (+   113us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:13.435569 (+   860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:13.436509 (+   940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:13.437616 (+  1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:13.438178 (+   562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:13.438297 (+   119us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:13.441193 (+  2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:13.441197 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:13.441197 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:13.441210 (+    13us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:13.443420 (+  2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:13.443831 (+   411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:13.443834 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:13.443835 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:13.443949 (+   114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:13.444332 (+   383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:13.444333 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:13.444333 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:13.444673 (+   340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:13.444834 (+   161us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:13.444964 (+   130us) server_negotiation.cc:299] Negotiation successful
0928 13:07:13.445066 (+   102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260928 13:07:13.446265  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:13.448093 24705 catalog_manager.cc:1347] Generated new cluster ID: 03daf2deb6b947808940565e1204713e
I20260928 13:07:13.448143 24705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:13.455592 24694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:13.447835 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42733 (local address 127.3.6.62:34717)
0928 13:07:13.447932 (+    97us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:13.447934 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:13.448082 (+   148us) server_negotiation.cc:407] Connection header received
0928 13:07:13.448103 (+    21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:13.448104 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:13.448113 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:13.448157 (+    44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:13.448838 (+   681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:13.449580 (+   742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:13.450679 (+  1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:13.451035 (+   356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:13.451092 (+    57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:13.452555 (+  1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:13.452556 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:13.452557 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:13.452563 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:13.454271 (+  1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:13.454649 (+   378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:13.454650 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:13.454650 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:13.454699 (+    49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:13.454893 (+   194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:13.454894 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:13.454894 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:13.455003 (+   109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:13.455116 (+   113us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:13.455443 (+   327us) server_negotiation.cc:299] Negotiation successful
0928 13:07:13.455497 (+    54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260928 13:07:13.467864 24705 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:13.468619 24705 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:13.490671 24705 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d8fe4f193ee34de5976fe8e1978fe1bc: Generated new TSK 0
I20260928 13:07:13.490914 24705 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:13.495386  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24623
W20260928 13:07:13.499672 24608 connection.cc:535] client connection to 127.3.6.62:34717 recv error: Network error: failed to read from TLS socket (remote: 127.3.6.62:34717): Connection reset by peer (error 104)
2026-09-28T13:07:13Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1345 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24722](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24722](info): set up 2 sockets
Sep 28 13:07:13 dist-test-slave-ddvw krb5kdc[24722](info): commencing operation
krb5kdc: starting...
W20260928 13:07:14.619642  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.106s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:14 dist-test-slave-ddvw krb5kdc[24722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600834, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:14.733697  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42357
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:46613
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42357
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:14.814580 24735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:14.814877 24735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:14.814916 24735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:14.816160 24735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:14.816246 24735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:14.816270 24735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:14.816291 24735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:14.816323 24735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:14.817885 24735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:46613
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42357
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:14.818179 24735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:14.818426 24735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:14.823596 24741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:14.823540 24743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:14.823570 24735 server_base.cc:1034] running on GCE node
W20260928 13:07:14.823541 24740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:14.824031 24735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:14.824332 24735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:14.825506 24735 hybrid_clock.cc:648] HybridClock initialized: now 1790600834825489 us; error 29 us; skew 500 ppm
Sep 28 13:07:14 dist-test-slave-ddvw krb5kdc[24722](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600834, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:14.831487 24735 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:14.832137 24735 webserver.cc:460] Webserver started at http://127.3.6.62:44463/ using document root <none> and password file <none>
I20260928 13:07:14.832407 24735 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:14.832454 24735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:14.832602 24735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:14.833721 24735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "66a6d50e71df41a79547cf80456ca31e"
format_stamp: "Formatted at 2026-09-28 13:07:14 on dist-test-slave-ddvw"
server_key: "f7ebf39141c9b19504f41730df3dc80b"
server_key_iv: "d3afbc7006dbdc290d8fc0ab08179016"
server_key_version: "encryptionkey@0"
I20260928 13:07:14.834111 24735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "66a6d50e71df41a79547cf80456ca31e"
format_stamp: "Formatted at 2026-09-28 13:07:14 on dist-test-slave-ddvw"
server_key: "f7ebf39141c9b19504f41730df3dc80b"
server_key_iv: "d3afbc7006dbdc290d8fc0ab08179016"
server_key_version: "encryptionkey@0"
I20260928 13:07:14.835659 24735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:14.836405 24750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:14.836620 24735 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:14.836731 24735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "66a6d50e71df41a79547cf80456ca31e"
format_stamp: "Formatted at 2026-09-28 13:07:14 on dist-test-slave-ddvw"
server_key: "f7ebf39141c9b19504f41730df3dc80b"
server_key_iv: "d3afbc7006dbdc290d8fc0ab08179016"
server_key_version: "encryptionkey@0"
I20260928 13:07:14.836810 24735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:14.846493 24735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:14.848541 24735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:14.848708 24735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:14.852793 24735 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42357
I20260928 13:07:14.852826 24802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42357 every 8 connection(s)
I20260928 13:07:14.853190 24735 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:14.854043 24803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:14.856462 24803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e: Bootstrap starting.
I20260928 13:07:14.857041 24803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:14.857336 24803 log.cc:824] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:14.857934  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24735
I20260928 13:07:14.858026  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:14.858098 24803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e: No bootstrap required, opened a new log
I20260928 13:07:14.858246  3096 external_mini_cluster.cc:1428] Setting key ddc1d9bb6be39bbf2ede3d1af517e221
I20260928 13:07:14.861198 24803 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } }
I20260928 13:07:14.861418 24803 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:14.861487 24803 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a6d50e71df41a79547cf80456ca31e, State: Initialized, Role: FOLLOWER
I20260928 13:07:14.861629 24803 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } }
I20260928 13:07:14.861728 24803 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:14.861788 24803 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:14.861860 24803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:14.862764 24803 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } }
I20260928 13:07:14.862914 24803 leader_election.cc:302] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66a6d50e71df41a79547cf80456ca31e; no voters: 
I20260928 13:07:14.863118 24803 leader_election.cc:288] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:14.863390 24808 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:14.863416 24803 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:14.863528 24808 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [term 1 LEADER]: Becoming Leader. State: Replica: 66a6d50e71df41a79547cf80456ca31e, State: Running, Role: LEADER
I20260928 13:07:14.863651 24808 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } }
I20260928 13:07:14.863974 24808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66a6d50e71df41a79547cf80456ca31e. Latest consensus state: current_term: 1 leader_uuid: "66a6d50e71df41a79547cf80456ca31e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } } }
I20260928 13:07:14.864070 24808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:14.863986 24809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66a6d50e71df41a79547cf80456ca31e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66a6d50e71df41a79547cf80456ca31e" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42357 } } }
I20260928 13:07:14.864398 24809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:14.864259 24816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:14.865161 24816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:14.866405 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:14.858763 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59585 (local address 127.3.6.62:42357)
0928 13:07:14.858991 (+   228us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:14.859001 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:14.859065 (+    64us) server_negotiation.cc:407] Connection header received
0928 13:07:14.859669 (+   604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:14.859680 (+    11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:14.859745 (+    65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:14.859912 (+   167us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:14.860111 (+   199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:14.861567 (+  1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:14.862814 (+  1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:14.863494 (+   680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:14.863611 (+   117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:14.864724 (+  1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:14.864729 (+     5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:14.864729 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:14.865012 (+   283us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:14.865073 (+    61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:14.865092 (+    19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:14.865205 (+   113us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:14.866036 (+   831us) server_negotiation.cc:299] Negotiation successful
0928 13:07:14.866072 (+    36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":107,"threads_started":1}
I20260928 13:07:14.867101 24816 catalog_manager.cc:1347] Generated new cluster ID: 6664dddcbe784e14a85a1a2f875c11dd
I20260928 13:07:14.867151 24816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:14.867813  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:14.872782 24807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:14.869158 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40037 (local address 127.3.6.62:42357)
0928 13:07:14.869195 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:14.869197 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:14.869364 (+   167us) server_negotiation.cc:407] Connection header received
0928 13:07:14.869425 (+    61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:14.869426 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:14.869436 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:14.869488 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:14.869629 (+   141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:14.870324 (+   695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:14.871396 (+  1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:14.871701 (+   305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:14.871759 (+    58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:14.872514 (+   755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:14.872515 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:14.872515 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:14.872520 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:14.872535 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:14.872539 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:14.872594 (+    55us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:14.872695 (+   101us) server_negotiation.cc:299] Negotiation successful
0928 13:07:14.872705 (+    10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 13:07:14.913918 24816 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:14.914723 24816 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:14.921006 24816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66a6d50e71df41a79547cf80456ca31e: Generated new TSK 0
I20260928 13:07:14.921250 24816 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:14.932055  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24735
W20260928 13:07:14.936566 24720 connection.cc:535] client connection to 127.3.6.62:42357 recv error: Network error: failed to read from TLS socket (remote: 127.3.6.62:42357): Connection reset by peer (error 104)
2026-09-28T13:07:14Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1436 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:14 dist-test-slave-ddvw krb5kdc[24834](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:14 dist-test-slave-ddvw krb5kdc[24834](info): set up 2 sockets
Sep 28 13:07:14 dist-test-slave-ddvw krb5kdc[24834](info): commencing operation
krb5kdc: starting...
W20260928 13:07:15.963253  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.013s	user 0.000s	sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:16 dist-test-slave-ddvw krb5kdc[24834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:16.082199  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34533
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:34533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:16.163422 24847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:16.163666 24847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:16.163705 24847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:16.164904 24847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:16.164974 24847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:16.165000 24847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:16.165033 24847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:16.165057 24847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:16.166517 24847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:34533
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:34533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:16.166785 24847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:16.167057 24847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:16.171852 24855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:16.171860 24852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:16.171860 24853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:16.172065 24847 server_base.cc:1034] running on GCE node
I20260928 13:07:16.172403 24847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:16.172708 24847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:16.173885 24847 hybrid_clock.cc:648] HybridClock initialized: now 1790600836173870 us; error 48 us; skew 500 ppm
Sep 28 13:07:16 dist-test-slave-ddvw krb5kdc[24834](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600836, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:16.176523 24847 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:16.176959 24847 webserver.cc:460] Webserver started at http://127.3.6.62:42049/ using document root <none> and password file <none>
I20260928 13:07:16.177186 24847 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:16.177263 24847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:16.177412 24847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:16.178483 24847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "2c0140a0b28e43cb8b5beea153d84ba1"
format_stamp: "Formatted at 2026-09-28 13:07:16 on dist-test-slave-ddvw"
server_key: "6e5cafa9872311efb3ab4876ae415059"
server_key_iv: "c9cfdfd744a9d7f3cde1b842da28780b"
server_key_version: "encryptionkey@0"
I20260928 13:07:16.178844 24847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "2c0140a0b28e43cb8b5beea153d84ba1"
format_stamp: "Formatted at 2026-09-28 13:07:16 on dist-test-slave-ddvw"
server_key: "6e5cafa9872311efb3ab4876ae415059"
server_key_iv: "c9cfdfd744a9d7f3cde1b842da28780b"
server_key_version: "encryptionkey@0"
I20260928 13:07:16.180270 24847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:16.180982 24862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:16.181157 24847 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.001s
I20260928 13:07:16.181294 24847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "2c0140a0b28e43cb8b5beea153d84ba1"
format_stamp: "Formatted at 2026-09-28 13:07:16 on dist-test-slave-ddvw"
server_key: "6e5cafa9872311efb3ab4876ae415059"
server_key_iv: "c9cfdfd744a9d7f3cde1b842da28780b"
server_key_version: "encryptionkey@0"
I20260928 13:07:16.181372 24847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:16.184583 24847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:16.186342 24847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:16.186497 24847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:16.190218 24847 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:34533
I20260928 13:07:16.190248 24914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:34533 every 8 connection(s)
I20260928 13:07:16.190567 24847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:16.191593 24915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:16.193750 24915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1: Bootstrap starting.
I20260928 13:07:16.194332 24915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:16.194609 24915 log.cc:824] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:16.195330 24915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1: No bootstrap required, opened a new log
I20260928 13:07:16.196902  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24847
I20260928 13:07:16.197026  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:16.197016 24915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } }
I20260928 13:07:16.197196  3096 external_mini_cluster.cc:1428] Setting key 44768583ad093bc59981625c846b7a73
I20260928 13:07:16.197188 24915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:16.197228 24915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0140a0b28e43cb8b5beea153d84ba1, State: Initialized, Role: FOLLOWER
I20260928 13:07:16.197386 24915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } }
I20260928 13:07:16.197475 24915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:16.197511 24915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:16.197613 24915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:16.198518 24915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } }
I20260928 13:07:16.198622 24915 leader_election.cc:302] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c0140a0b28e43cb8b5beea153d84ba1; no voters: 
I20260928 13:07:16.198781 24915 leader_election.cc:288] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:16.198832 24920 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:16.198987 24920 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [term 1 LEADER]: Becoming Leader. State: Replica: 2c0140a0b28e43cb8b5beea153d84ba1, State: Running, Role: LEADER
I20260928 13:07:16.199083 24915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:16.199142 24920 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } }
I20260928 13:07:16.199483 24919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:16.197772 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35313 (local address 127.3.6.62:34533)
0928 13:07:16.197956 (+   184us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:16.197964 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:16.197987 (+    23us) server_negotiation.cc:407] Connection header received
0928 13:07:16.198083 (+    96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:16.198088 (+     5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:16.198111 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:16.198248 (+   137us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:16.198921 (+   673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:16.198924 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:16.198925 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:16.198929 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:16.198971 (+    42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:16.198988 (+    17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:16.199205 (+   217us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:16.199233 (+    28us) server_negotiation.cc:299] Negotiation successful
0928 13:07:16.199278 (+    45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260928 13:07:16.199836 24922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } } }
I20260928 13:07:16.199928 24922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:16.200129 24929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:16.199819 24920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c0140a0b28e43cb8b5beea153d84ba1. Latest consensus state: current_term: 1 leader_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0140a0b28e43cb8b5beea153d84ba1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 34533 } } }
I20260928 13:07:16.200361 24920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:16.200564  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:16.200706 24929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:16.202358 24929 catalog_manager.cc:1347] Generated new cluster ID: 3d5773b35bbc44e882b5988c1db1a23e
I20260928 13:07:16.202405 24929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:16.203408 24919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:16.202085 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50801 (local address 127.3.6.62:34533)
0928 13:07:16.202120 (+    35us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:16.202122 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:16.202406 (+   284us) server_negotiation.cc:407] Connection header received
0928 13:07:16.202468 (+    62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:16.202469 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:16.202489 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:16.202550 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:16.203193 (+   643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:16.203194 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:16.203194 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:16.203199 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:16.203212 (+    13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:16.203216 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:16.203282 (+    66us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:16.203342 (+    60us) server_negotiation.cc:299] Negotiation successful
0928 13:07:16.203353 (+    11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:07:16.216341 24929 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:16.216540 24929 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:16.224174 24929 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c0140a0b28e43cb8b5beea153d84ba1: Generated new TSK 0
I20260928 13:07:16.224406 24929 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:16.226704  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24847
2026-09-28T13:07:16Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1294 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:16 dist-test-slave-ddvw krb5kdc[24946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:16 dist-test-slave-ddvw krb5kdc[24946](info): set up 2 sockets
Sep 28 13:07:16 dist-test-slave-ddvw krb5kdc[24946](info): commencing operation
krb5kdc: starting...
W20260928 13:07:17.259274  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.014s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[24946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:17.377609  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:40003
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:45813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:40003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:17.459038 24959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:17.459311 24959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:17.459352 24959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:17.460546 24959 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:17.460628 24959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:17.460655 24959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:17.460688 24959 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:17.460712 24959 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:17.462514 24959 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:45813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:40003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:40003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24959
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:17.462806 24959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:17.463068 24959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:17.467989 24964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:17.468004 24967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:17.468024 24959 server_base.cc:1034] running on GCE node
W20260928 13:07:17.468004 24965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:17.468513 24959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:17.468863 24959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:17.470036 24959 hybrid_clock.cc:648] HybridClock initialized: now 1790600837470032 us; error 38 us; skew 500 ppm
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[24946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600837, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:17.472627 24959 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:17.473107 24959 webserver.cc:460] Webserver started at http://127.3.6.62:35091/ using document root <none> and password file <none>
I20260928 13:07:17.473363 24959 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:17.473435 24959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:17.473583 24959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:17.474711 24959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "560dd15250ec4f7085acc411c4dae5ee"
format_stamp: "Formatted at 2026-09-28 13:07:17 on dist-test-slave-ddvw"
server_key: "42a29b50a14f2e693bd32ea46bc7d3fd"
server_key_iv: "5786ab542025a7e3a4dd3e0aad5b84b4"
server_key_version: "encryptionkey@0"
I20260928 13:07:17.475174 24959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "560dd15250ec4f7085acc411c4dae5ee"
format_stamp: "Formatted at 2026-09-28 13:07:17 on dist-test-slave-ddvw"
server_key: "42a29b50a14f2e693bd32ea46bc7d3fd"
server_key_iv: "5786ab542025a7e3a4dd3e0aad5b84b4"
server_key_version: "encryptionkey@0"
I20260928 13:07:17.476594 24959 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:17.477391 24974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:17.477568 24959 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:17.477669 24959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "560dd15250ec4f7085acc411c4dae5ee"
format_stamp: "Formatted at 2026-09-28 13:07:17 on dist-test-slave-ddvw"
server_key: "42a29b50a14f2e693bd32ea46bc7d3fd"
server_key_iv: "5786ab542025a7e3a4dd3e0aad5b84b4"
server_key_version: "encryptionkey@0"
I20260928 13:07:17.477773 24959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:17.498265 24959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:17.500375 24959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:17.500538 24959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:17.504458 24959 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:40003
I20260928 13:07:17.504500 25026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:40003 every 8 connection(s)
I20260928 13:07:17.504878 24959 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:17.505717 25027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:17.508024 25027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee: Bootstrap starting.
I20260928 13:07:17.508600 25027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:17.508880 25027 log.cc:824] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:17.509557 25027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee: No bootstrap required, opened a new log
I20260928 13:07:17.511117 25027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } }
I20260928 13:07:17.511277 25027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:17.511301 25027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 560dd15250ec4f7085acc411c4dae5ee, State: Initialized, Role: FOLLOWER
I20260928 13:07:17.511474 25027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } }
I20260928 13:07:17.511533 25027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:17.511587 25027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:17.511643 25027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:17.512179 25027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } }
I20260928 13:07:17.512305 25027 leader_election.cc:302] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 560dd15250ec4f7085acc411c4dae5ee; no voters: 
I20260928 13:07:17.512470 25027 leader_election.cc:288] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:17.512499 25030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:17.512610 25030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [term 1 LEADER]: Becoming Leader. State: Replica: 560dd15250ec4f7085acc411c4dae5ee, State: Running, Role: LEADER
I20260928 13:07:17.512620  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 24959
I20260928 13:07:17.512734  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:17.512732 25027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:17.512770 25030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } }
I20260928 13:07:17.512912  3096 external_mini_cluster.cc:1428] Setting key 6888b17a8b65044311f9048e41edf9d7
I20260928 13:07:17.513338 25032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "560dd15250ec4f7085acc411c4dae5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } } }
I20260928 13:07:17.513427 25032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:17.513871 25040 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:17.514144 25031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 560dd15250ec4f7085acc411c4dae5ee. Latest consensus state: current_term: 1 leader_uuid: "560dd15250ec4f7085acc411c4dae5ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560dd15250ec4f7085acc411c4dae5ee" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 40003 } } }
I20260928 13:07:17.514277 25031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:17.514505 25040 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:17.516076 25040 catalog_manager.cc:1347] Generated new cluster ID: bddf51c8019b4d9e89abfb6580cea07b
I20260928 13:07:17.516137 25040 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[24946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600837, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:17.524991 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:17.513514 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52123 (local address 127.3.6.62:40003)
0928 13:07:17.513675 (+   161us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:17.513686 (+    11us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:17.513924 (+   238us) server_negotiation.cc:407] Connection header received
0928 13:07:17.514180 (+   256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:17.514189 (+     9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:17.514293 (+   104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:17.514443 (+   150us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:17.515166 (+   723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:17.516497 (+  1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:17.517543 (+  1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:17.518194 (+   651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:17.518311 (+   117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:17.521213 (+  2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:17.521223 (+    10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:17.521223 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:17.521235 (+    12us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:17.523280 (+  2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:17.523691 (+   411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:17.523694 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:17.523694 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:17.523816 (+   122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:17.524031 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:17.524032 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:17.524033 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:17.524349 (+   316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:17.524505 (+   156us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:17.524623 (+   118us) server_negotiation.cc:299] Negotiation successful
0928 13:07:17.524764 (+   141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":76,"threads_started":1}
I20260928 13:07:17.525961  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:17.534654 25041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:17.527403 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44777 (local address 127.3.6.62:40003)
0928 13:07:17.527434 (+    31us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:17.527436 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:17.527570 (+   134us) server_negotiation.cc:407] Connection header received
0928 13:07:17.527622 (+    52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:17.527622 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:17.527644 (+    22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:17.527700 (+    56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:17.528327 (+   627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:17.529072 (+   745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:17.530114 (+  1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:17.530433 (+   319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:17.530498 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:17.531917 (+  1419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:17.531918 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:17.531919 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:17.531925 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:17.533469 (+  1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:17.533875 (+   406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:17.533876 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:17.533876 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:17.533930 (+    54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:17.534132 (+   202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:17.534133 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:17.534133 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:17.534263 (+   130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:17.534355 (+    92us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:17.534491 (+   136us) server_negotiation.cc:299] Negotiation successful
0928 13:07:17.534564 (+    73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260928 13:07:17.553391 25040 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:17.553973 25040 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:17.557264 25040 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 560dd15250ec4f7085acc411c4dae5ee: Generated new TSK 0
I20260928 13:07:17.557466 25040 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:17.567329  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 24959
2026-09-28T13:07:17Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1340 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[25058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[25058](info): set up 2 sockets
Sep 28 13:07:17 dist-test-slave-ddvw krb5kdc[25058](info): commencing operation
krb5kdc: starting...
W20260928 13:07:18.599308  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.014s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:18 dist-test-slave-ddvw krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600838, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:18.722456  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42927
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:46609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:18.805794 25071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:18.806005 25071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:18.806028 25071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:18.807219 25071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:18.807263 25071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:18.807278 25071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:18.807291 25071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:18.807303 25071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:18.808734 25071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:46609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42927
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:18.808920 25071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:18.809080 25071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:18.814256 25079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:18.814428 25071 server_base.cc:1034] running on GCE node
W20260928 13:07:18.814240 25076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:18.814265 25077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:18.814831 25071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:18.815271 25071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:18.816471 25071 hybrid_clock.cc:648] HybridClock initialized: now 1790600838816457 us; error 28 us; skew 500 ppm
Sep 28 13:07:18 dist-test-slave-ddvw krb5kdc[25058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600838, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:18.819386 25071 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:18.819890 25071 webserver.cc:460] Webserver started at http://127.3.6.62:34371/ using document root <none> and password file <none>
I20260928 13:07:18.820163 25071 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:18.820241 25071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:18.820401 25071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:18.821574 25071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "188c3a8e19454891930d8f4b86a6bee1"
format_stamp: "Formatted at 2026-09-28 13:07:18 on dist-test-slave-ddvw"
server_key: "11b838e67b60735f6a1a84755565668a"
server_key_iv: "0b4721c513d96004af2f39fd9a65c94b"
server_key_version: "encryptionkey@0"
I20260928 13:07:18.821977 25071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "188c3a8e19454891930d8f4b86a6bee1"
format_stamp: "Formatted at 2026-09-28 13:07:18 on dist-test-slave-ddvw"
server_key: "11b838e67b60735f6a1a84755565668a"
server_key_iv: "0b4721c513d96004af2f39fd9a65c94b"
server_key_version: "encryptionkey@0"
I20260928 13:07:18.823601 25071 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:18.824456 25086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:18.824791 25071 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:18.824903 25071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "188c3a8e19454891930d8f4b86a6bee1"
format_stamp: "Formatted at 2026-09-28 13:07:18 on dist-test-slave-ddvw"
server_key: "11b838e67b60735f6a1a84755565668a"
server_key_iv: "0b4721c513d96004af2f39fd9a65c94b"
server_key_version: "encryptionkey@0"
I20260928 13:07:18.824985 25071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:18.844573 25071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:18.847182 25071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:18.847357 25071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:18.851732 25071 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42927
I20260928 13:07:18.851778 25138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42927 every 8 connection(s)
I20260928 13:07:18.852197 25071 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:18.853101 25139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:18.855605 25139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1: Bootstrap starting.
I20260928 13:07:18.856282 25139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:18.856575 25139 log.cc:824] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:18.857349 25139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1: No bootstrap required, opened a new log
I20260928 13:07:18.857964  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25071
I20260928 13:07:18.858232  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:18.858407  3096 external_mini_cluster.cc:1428] Setting key 3b9212cc514a59754030ae5f7f4f4ca0
I20260928 13:07:18.859567 25139 raft_consensus.cc:348] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } }
I20260928 13:07:18.859743 25139 raft_consensus.cc:374] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:18.859782 25139 raft_consensus.cc:729] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 188c3a8e19454891930d8f4b86a6bee1, State: Initialized, Role: FOLLOWER
I20260928 13:07:18.859990 25139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } }
I20260928 13:07:18.860100 25139 raft_consensus.cc:388] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:18.860124 25139 raft_consensus.cc:482] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:18.860203 25139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:18.860790 25139 raft_consensus.cc:504] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } }
I20260928 13:07:18.860877 25139 leader_election.cc:302] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 188c3a8e19454891930d8f4b86a6bee1; no voters: 
I20260928 13:07:18.861060 25139 leader_election.cc:288] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:18.861089 25144 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:18.861196 25144 raft_consensus.cc:686] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [term 1 LEADER]: Becoming Leader. State: Replica: 188c3a8e19454891930d8f4b86a6bee1, State: Running, Role: LEADER
I20260928 13:07:18.861343 25139 sys_catalog.cc:564] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:18.861333 25144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } }
I20260928 13:07:18.861842 25146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "188c3a8e19454891930d8f4b86a6bee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } } }
I20260928 13:07:18.862105 25146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:18.862017 25145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 188c3a8e19454891930d8f4b86a6bee1. Latest consensus state: current_term: 1 leader_uuid: "188c3a8e19454891930d8f4b86a6bee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "188c3a8e19454891930d8f4b86a6bee1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42927 } } }
I20260928 13:07:18.862550 25153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:18.862576 25145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:18.863116 25153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:18.864917 25153 catalog_manager.cc:1347] Generated new cluster ID: 62cf707b57bd4e64ab60660d56ff1214
I20260928 13:07:18.865043 25153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:18.865176 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:18.859071 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36789 (local address 127.3.6.62:42927)
0928 13:07:18.859289 (+   218us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:18.859305 (+    16us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:18.859335 (+    30us) server_negotiation.cc:407] Connection header received
0928 13:07:18.859561 (+   226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:18.859567 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:18.859619 (+    52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:18.859761 (+   142us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:18.860010 (+   249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:18.861545 (+  1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:18.862727 (+  1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:18.863359 (+   632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:18.863474 (+   115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:18.864263 (+   789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:18.864267 (+     4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:18.864268 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:18.864509 (+   241us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:18.864547 (+    38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:18.864562 (+    15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:18.864631 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:18.864732 (+   101us) server_negotiation.cc:299] Negotiation successful
0928 13:07:18.864804 (+    72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":117,"threads_started":1}
I20260928 13:07:18.866140  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:18.871340 25143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:18.867759 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48371 (local address 127.3.6.62:42927)
0928 13:07:18.867793 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:18.867795 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:18.867892 (+    97us) server_negotiation.cc:407] Connection header received
0928 13:07:18.867936 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:18.867937 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:18.867948 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:18.868017 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:18.868147 (+   130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:18.868874 (+   727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:18.869862 (+   988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:18.870226 (+   364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:18.870304 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:18.871066 (+   762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:18.871068 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:18.871068 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:18.871073 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:18.871090 (+    17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:18.871095 (+     5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:18.871156 (+    61us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:18.871221 (+    65us) server_negotiation.cc:299] Negotiation successful
0928 13:07:18.871248 (+    27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 13:07:18.876458 25153 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:18.877002 25153 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:18.880064 25153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 188c3a8e19454891930d8f4b86a6bee1: Generated new TSK 0
I20260928 13:07:18.880349 25153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:18.888646  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25071
2026-09-28T13:07:18Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1320 ms)
[ RUN      ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:18 dist-test-slave-ddvw krb5kdc[25170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:18 dist-test-slave-ddvw krb5kdc[25170](info): set up 2 sockets
Sep 28 13:07:18 dist-test-slave-ddvw krb5kdc[25170](info): commencing operation
krb5kdc: starting...
W20260928 13:07:19.923291  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.017s	user 0.004s	sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:20 dist-test-slave-ddvw krb5kdc[25170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:20.042065  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:39463
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:39463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:20.124150 25183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:20.124404 25183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:20.124444 25183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:20.125607 25183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:20.125679 25183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:20.125705 25183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:20.125725 25183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:20.125754 25183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:20.127343 25183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:39463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:39463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:20.127624 25183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:20.127858 25183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:20.132697 25189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:20.132761 25191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:20.132921 25183 server_base.cc:1034] running on GCE node
W20260928 13:07:20.132697 25188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:20.133232 25183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:20.133481 25183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:20.134646 25183 hybrid_clock.cc:648] HybridClock initialized: now 1790600840134635 us; error 34 us; skew 500 ppm
Sep 28 13:07:20 dist-test-slave-ddvw krb5kdc[25170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600840, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:20.140451 25183 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:20.140904 25183 webserver.cc:460] Webserver started at http://127.3.6.62:36309/ using document root <none> and password file <none>
I20260928 13:07:20.141160 25183 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:20.141232 25183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:20.141381 25183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:20.142460 25183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "4953331b7ea34951991920966dadf702"
format_stamp: "Formatted at 2026-09-28 13:07:20 on dist-test-slave-ddvw"
server_key: "e12e592f9610ba0a534e12e7b651c9e0"
server_key_iv: "a1595ee4dfc335e12a56ed3dfa9799f9"
server_key_version: "encryptionkey@0"
I20260928 13:07:20.142831 25183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "4953331b7ea34951991920966dadf702"
format_stamp: "Formatted at 2026-09-28 13:07:20 on dist-test-slave-ddvw"
server_key: "e12e592f9610ba0a534e12e7b651c9e0"
server_key_iv: "a1595ee4dfc335e12a56ed3dfa9799f9"
server_key_version: "encryptionkey@0"
I20260928 13:07:20.144248 25183 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:20.144999 25198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:20.145164 25183 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:20.145259 25183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "4953331b7ea34951991920966dadf702"
format_stamp: "Formatted at 2026-09-28 13:07:20 on dist-test-slave-ddvw"
server_key: "e12e592f9610ba0a534e12e7b651c9e0"
server_key_iv: "a1595ee4dfc335e12a56ed3dfa9799f9"
server_key_version: "encryptionkey@0"
I20260928 13:07:20.145344 25183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:20.148840 25183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:20.150771 25183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:20.150924 25183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:20.154656 25183 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:39463
I20260928 13:07:20.154731 25250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:39463 every 8 connection(s)
I20260928 13:07:20.155125 25183 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:20.156141 25251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:20.157013  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25183
I20260928 13:07:20.157136  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:20.157305  3096 external_mini_cluster.cc:1428] Setting key cb047305bc3a9020796438cd9c7be3ca
I20260928 13:07:20.158815 25251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702: Bootstrap starting.
I20260928 13:07:20.159575 25251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:20.159929 25251 log.cc:824] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:20.160105 25254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:20.157832 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32933 (local address 127.3.6.62:39463)
0928 13:07:20.158013 (+   181us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:20.158020 (+     7us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:20.158046 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:07:20.158589 (+   543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:20.158595 (+     6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:20.158624 (+    29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:20.158747 (+   123us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:20.159559 (+   812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:20.159562 (+     3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:20.159562 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:20.159566 (+     4us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:20.159608 (+    42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:20.159620 (+    12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:20.159733 (+   113us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:20.159804 (+    71us) server_negotiation.cc:299] Negotiation successful
0928 13:07:20.159856 (+    52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260928 13:07:20.160717 25251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702: No bootstrap required, opened a new log
I20260928 13:07:20.161123  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:20.162875 25251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } }
I20260928 13:07:20.163064 25251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 13:07:20.163113 25251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4953331b7ea34951991920966dadf702, State: Initialized, Role: FOLLOWER
I20260928 13:07:20.163244 25251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } }
I20260928 13:07:20.163345 25251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 13:07:20.163396 25251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 13:07:20.163447 25251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:20.163682 25254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:20.162552 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60959 (local address 127.3.6.62:39463)
0928 13:07:20.162595 (+    43us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:20.162597 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:20.162703 (+   106us) server_negotiation.cc:407] Connection header received
0928 13:07:20.162728 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:20.162729 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:20.162734 (+     5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:20.162803 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:20.163433 (+   630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:20.163435 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:20.163435 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 13:07:20.163440 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:20.163455 (+    15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 13:07:20.163459 (+     4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:20.163516 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:20.163578 (+    62us) server_negotiation.cc:299] Negotiation successful
0928 13:07:20.163594 (+    16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:07:20.164223 25251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } }
I20260928 13:07:20.164331 25251 leader_election.cc:302] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4953331b7ea34951991920966dadf702; no voters: 
I20260928 13:07:20.164485 25251 leader_election.cc:288] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260928 13:07:20.164508 25261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:20.164664 25261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [term 1 LEADER]: Becoming Leader. State: Replica: 4953331b7ea34951991920966dadf702, State: Running, Role: LEADER
I20260928 13:07:20.164753 25251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:20.164780 25261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } }
I20260928 13:07:20.165202 25262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4953331b7ea34951991920966dadf702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } } }
I20260928 13:07:20.165237 25263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4953331b7ea34951991920966dadf702. Latest consensus state: current_term: 1 leader_uuid: "4953331b7ea34951991920966dadf702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4953331b7ea34951991920966dadf702" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 39463 } } }
I20260928 13:07:20.165308 25262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:20.165326 25263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:20.165519 25268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:20.166008 25268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:20.168092 25268 catalog_manager.cc:1347] Generated new cluster ID: 7fbc3417396e4f4aba803a2b1b49473d
I20260928 13:07:20.168159 25268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:20.186734 25268 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:20.186939 25268 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:20.192334 25268 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4953331b7ea34951991920966dadf702: Generated new TSK 0
I20260928 13:07:20.192565 25268 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:20.202701  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25183
2026-09-28T13:07:20Z chronyd exiting
[       OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1314 ms)
[----------] 18 tests from AuthTokenIssuingTest (23997 ms total)

[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN      ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:20 dist-test-slave-ddvw krb5kdc[25282](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:20 dist-test-slave-ddvw krb5kdc[25282](info): set up 2 sockets
Sep 28 13:07:20 dist-test-slave-ddvw krb5kdc[25282](info): commencing operation
krb5kdc: starting...
W20260928 13:07:21.235261  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.015s	user 0.001s	sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:21.356137  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37117
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:21.439263 25295 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:21.439534 25295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:21.439579 25295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:21.439615 25295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:21.440923 25295 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:21.441001 25295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:21.441028 25295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:21.441059 25295 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:21.441092 25295 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:21.442634 25295 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:37117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:21.442919 25295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:21.443209 25295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:07:21.448406 25295 server_base.cc:1034] running on GCE node
W20260928 13:07:21.448310 25303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.448329 25300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.448310 25301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:21.448897 25295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:21.449267 25295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:21.450440 25295 hybrid_clock.cc:648] HybridClock initialized: now 1790600841450427 us; error 46 us; skew 500 ppm
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:21.453177 25295 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:21.453667 25295 webserver.cc:460] Webserver started at http://127.3.6.62:45163/ using document root <none> and password file <none>
I20260928 13:07:21.453873 25295 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:21.453915 25295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:21.454013 25295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:21.455119 25295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "5b1cf07783374f8ca5d4442288d29df1"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "8a8e474c40f746c36a3ff037d042b81b"
server_key_iv: "3075d98c7c900e9ddd4b9873fde7214e"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.455443 25295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "5b1cf07783374f8ca5d4442288d29df1"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "8a8e474c40f746c36a3ff037d042b81b"
server_key_iv: "3075d98c7c900e9ddd4b9873fde7214e"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.456720 25295 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:21.457481 25310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:21.457702 25295 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:21.457794 25295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "5b1cf07783374f8ca5d4442288d29df1"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "8a8e474c40f746c36a3ff037d042b81b"
server_key_iv: "3075d98c7c900e9ddd4b9873fde7214e"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.457852 25295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:21.481294 25295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:21.483677 25295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:21.483793 25295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:21.487885 25295 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:37117
I20260928 13:07:21.487916 25362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:37117 every 8 connection(s)
I20260928 13:07:21.488300 25295 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:21.489337 25363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:21.490955  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25295
I20260928 13:07:21.490849 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:21.491111  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:21.491286  3096 external_mini_cluster.cc:1428] Setting key a0a46d666add6ce94015da1dfa689231
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.61@KRBTEST.COM; defaulting to no policy
I20260928 13:07:21.501653 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.491603 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37117 (local address 127.0.0.1:42512)
0928 13:07:21.491807 (+   204us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.491848 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.492583 (+   735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.492923 (+   340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.492925 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.493167 (+   242us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.493321 (+   154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.493325 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.494454 (+  1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.494455 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.495258 (+   803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.495261 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.495970 (+   709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.496000 (+    30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.496056 (+    56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.496631 (+   575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.496639 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.498267 (+  1628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.500307 (+  2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.500313 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.500315 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.500493 (+   178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.500713 (+   220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.500714 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.500714 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.500788 (+    74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.501169 (+   381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.501175 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.501244 (+    69us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.501321 (+    77us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.501441 (+   120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":87,"threads_started":1}
I20260928 13:07:21.501660 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.491619 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42512 (local address 127.3.6.62:37117)
0928 13:07:21.491776 (+   157us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.491786 (+    10us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.491947 (+   161us) server_negotiation.cc:407] Connection header received
0928 13:07:21.492761 (+   814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.492764 (+     3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.492791 (+    27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.492899 (+   108us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.493420 (+   521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.494367 (+   947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.495337 (+   970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.495874 (+   537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.495982 (+   108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.498361 (+  2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.498369 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.498369 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.498376 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.500227 (+  1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.500567 (+   340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.500570 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.500570 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.500652 (+    82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.500842 (+   190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.500843 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.500843 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.501091 (+   248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.501162 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.501358 (+   196us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.501496 (+   138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.61@KRBTEST.COM" created.
I20260928 13:07:21.502511 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:21.502866 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.502749 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60096)
0928 13:07:21.502798 (+    49us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.502838 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260928 13:07:21.503059 25314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
I20260928 13:07:21.503439 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.503375 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60104)
0928 13:07:21.503400 (+    25us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.503423 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260928 13:07:21.503554 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44171: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
I20260928 13:07:21.517179  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:44171
--webserver_interface=127.3.6.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:07:21.552790 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } attempt: 1
I20260928 13:07:21.553354 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.553183 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60112)
0928 13:07:21.553260 (+    77us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.553312 (+    52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260928 13:07:21.553763 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.553660 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60126)
0928 13:07:21.553706 (+    46us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.553738 (+    32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:07:21.553879 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44171: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
W20260928 13:07:21.597955 25370 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:21.598176 25370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:21.598193 25370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:21.598213 25370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:21.599422 25370 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:21.599462 25370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:21.599475 25370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:21.599530 25370 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:21.599555 25370 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:21.601035 25370 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:44171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.6.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:21.601305 25370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:21.601524 25370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:21.606403 25375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.606416 25376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.606416 25378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:21.606684 25370 server_base.cc:1034] running on GCE node
I20260928 13:07:21.606895 25370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:21.607260 25370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:21.608408 25370 hybrid_clock.cc:648] HybridClock initialized: now 1790600841608401 us; error 30 us; skew 500 ppm
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:21.610818 25370 init.cc:377] Logged in from keytab as kudu/127.3.6.61@KRBTEST.COM (short username kudu)
I20260928 13:07:21.611317 25370 webserver.cc:460] Webserver started at http://127.3.6.61:37853/ using document root <none> and password file <none>
I20260928 13:07:21.611788 25370 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:21.611886 25370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:21.612090 25370 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:21.613166 25370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data/instance:
uuid: "d938f758518041f09d72bd56d74a170a"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "6a0bd3845dc006da7d8c0caa69fba2b7"
server_key_iv: "e8b4494948bb78745768f2fde5e7a319"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.613539 25370 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal/instance:
uuid: "d938f758518041f09d72bd56d74a170a"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "6a0bd3845dc006da7d8c0caa69fba2b7"
server_key_iv: "e8b4494948bb78745768f2fde5e7a319"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.614908 25370 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:21.615725 25385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:21.615958 25370 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:21.616109 25370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "d938f758518041f09d72bd56d74a170a"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "6a0bd3845dc006da7d8c0caa69fba2b7"
server_key_iv: "e8b4494948bb78745768f2fde5e7a319"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.616210 25370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:21.622049 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } attempt: 2
I20260928 13:07:21.622493 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.622343 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60138)
0928 13:07:21.622407 (+    64us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.622454 (+    47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 13:07:21.622892 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.622803 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60154)
0928 13:07:21.622847 (+    44us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.622875 (+    28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 13:07:21.623026 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:44171: Network error: Client connection negotiation failed: client connection to 127.3.6.61:44171: connect: Connection refused (error 111)
I20260928 13:07:21.627607 25370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:21.629539 25370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:21.629714 25370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:21.634148 25370 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.61:44171
I20260928 13:07:21.634177 25437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.61:44171 every 8 connection(s)
I20260928 13:07:21.634583 25370 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
I20260928 13:07:21.635619 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:21.637084 25438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:21.641886  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25370
I20260928 13:07:21.642040  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-1/wal/instance
I20260928 13:07:21.642227  3096 external_mini_cluster.cc:1428] Setting key 4021f9ae77ea2cf057a6268043d1889d
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:21.647421 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.637733 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42522 (local address 127.3.6.62:37117)
0928 13:07:21.637815 (+    82us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.637818 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.637988 (+   170us) server_negotiation.cc:407] Connection header received
0928 13:07:21.638498 (+   510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.638500 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.638510 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.638572 (+    62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.639270 (+   698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.639820 (+   550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.640762 (+   942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.640970 (+   208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.641033 (+    63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.643904 (+  2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.643906 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.643906 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.643913 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.645740 (+  1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.646312 (+   572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.646313 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.646314 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.646371 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.646681 (+   310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.646682 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.646682 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.646800 (+   118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.646858 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.647271 (+   413us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.647349 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 13:07:21.647760 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.637690 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37117 (local address 127.0.0.1:42522)
0928 13:07:21.637869 (+   179us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.637905 (+    36us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.638374 (+   469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.638645 (+   271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.638649 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.638887 (+   238us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.639179 (+   292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.639184 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.639899 (+   715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.639900 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.640684 (+   784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.640686 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.641034 (+   348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.641054 (+    20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.641200 (+   146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.641763 (+   563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.641771 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.643756 (+  1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.645838 (+  2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.645847 (+     9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.645849 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.646226 (+   377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.646448 (+   222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.646448 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.646449 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.646608 (+   159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.646875 (+   267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.646883 (+     8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.647119 (+   236us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.647254 (+   135us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.647459 (+   205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260928 13:07:21.648453 25438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.3.6.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.60@KRBTEST.COM" created.
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:21.657088 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.648759 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60156)
0928 13:07:21.649077 (+   318us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.649094 (+    17us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.649163 (+    69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.649314 (+   151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.649315 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.649459 (+   144us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.649519 (+    60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.649520 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.650421 (+   901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.650422 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.650955 (+   533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.650957 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.651536 (+   579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.651539 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.651605 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.652049 (+   444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.652054 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.653947 (+  1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.656036 (+  2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.656036 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.656037 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.656202 (+   165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.656422 (+   220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.656423 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.656423 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.656473 (+    50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.656865 (+   392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.656866 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.656901 (+    35us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.656957 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.657025 (+    68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306}
I20260928 13:07:21.657244 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.648847 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.3.6.61:44171)
0928 13:07:21.649041 (+   194us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.649046 (+     5us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.649165 (+   119us) server_negotiation.cc:407] Connection header received
0928 13:07:21.649223 (+    58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.649225 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.649239 (+    14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.649313 (+    74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.649605 (+   292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.650327 (+   722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.651096 (+   769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.651447 (+   351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.651540 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.654038 (+  2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.654046 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.654047 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.654054 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.655937 (+  1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.656285 (+   348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.656289 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.656289 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.656353 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.656535 (+   182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.656536 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.656537 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.656735 (+   198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.656827 (+    92us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.657026 (+   199us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.657116 (+    90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":178,"threads_started":1}
I20260928 13:07:21.657850 25438 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:21.658202 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.658078 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57540)
0928 13:07:21.658115 (+    37us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.658169 (+    54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260928 13:07:21.658352 25389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
I20260928 13:07:21.658835 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.658742 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57550)
0928 13:07:21.658793 (+    51us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.658818 (+    25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260928 13:07:21.658972 25438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:43461: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
I20260928 13:07:21.669543  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:43461
--webserver_interface=127.3.6.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:36469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:07:21.708202 25438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } attempt: 1
I20260928 13:07:21.708678 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.708536 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57560)
0928 13:07:21.708603 (+    67us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.708649 (+    46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260928 13:07:21.709028 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.708933 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57562)
0928 13:07:21.708978 (+    45us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.709002 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260928 13:07:21.709120 25438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:43461: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
I20260928 13:07:21.714238 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } attempt: 3
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:21.721455 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.714588 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60162)
0928 13:07:21.714637 (+    49us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.714656 (+    19us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.714726 (+    70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.714885 (+   159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.714886 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.715128 (+   242us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.715191 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.715194 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.715882 (+   688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.715883 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.716485 (+   602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.716487 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.716888 (+   401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.716892 (+     4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.716982 (+    90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.717447 (+   465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.717452 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.718670 (+  1218us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.720393 (+  1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.720394 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.720395 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.720589 (+   194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.720805 (+   216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.720805 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.720806 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.720862 (+    56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.721123 (+   261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.721124 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.721171 (+    47us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.721258 (+    87us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.721358 (+   100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260928 13:07:21.721455 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.714653 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60162 (local address 127.3.6.61:44171)
0928 13:07:21.714721 (+    68us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.714723 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.714734 (+    11us) server_negotiation.cc:407] Connection header received
0928 13:07:21.714797 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.714798 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.714807 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.714880 (+    73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.715282 (+   402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.715784 (+   502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.716575 (+   791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.716805 (+   230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.716881 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.718762 (+  1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.718763 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.718763 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.718771 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.720294 (+  1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.720678 (+   384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.720679 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.720680 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.720738 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.720936 (+   198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.720937 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.720938 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.721055 (+   117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.721131 (+    76us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.721283 (+   152us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.721360 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 13:07:21.721892 25363 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:21.723219 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.722185 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57578)
0928 13:07:21.723162 (+   977us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.723197 (+    35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":961}
I20260928 13:07:21.723526 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.723431 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57580)
0928 13:07:21.723481 (+    50us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.723505 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260928 13:07:21.723618 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:43461: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
W20260928 13:07:21.751322 25445 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:21.751595 25445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:21.751632 25445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:21.751689 25445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:21.752902 25445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:21.752988 25445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:21.753016 25445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:21.753049 25445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:21.753069 25445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:21.754724 25445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:36469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:37117,127.3.6.61:44171,127.3.6.60:43461
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:43461
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.6.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:21.754763 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } attempt: 1
I20260928 13:07:21.755067 25445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:21.755280 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.755139 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57590)
0928 13:07:21.755209 (+    70us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.755250 (+    41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260928 13:07:21.755339 25445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 13:07:21.755749 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.755620 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57606)
0928 13:07:21.755680 (+    60us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.755718 (+    38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260928 13:07:21.755975 25363 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:43461: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
W20260928 13:07:21.760641 25453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.760612 25451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:21.760644 25450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:21.760795 25445 server_base.cc:1034] running on GCE node
I20260928 13:07:21.761053 25445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:21.761348 25445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:21.762491 25445 hybrid_clock.cc:648] HybridClock initialized: now 1790600841762469 us; error 38 us; skew 500 ppm
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:21.765162 25445 init.cc:377] Logged in from keytab as kudu/127.3.6.60@KRBTEST.COM (short username kudu)
I20260928 13:07:21.765664 25445 webserver.cc:460] Webserver started at http://127.3.6.60:34683/ using document root <none> and password file <none>
I20260928 13:07:21.765914 25445 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:21.765983 25445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:21.766135 25445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:21.767311 25445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data/instance:
uuid: "504f0997d6a249e9b442cb44f6232e9e"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "300ded82f010af0ab5753c344604c9f0"
server_key_iv: "a4f287969969190f698b748beb5b2cf7"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.767679 25445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal/instance:
uuid: "504f0997d6a249e9b442cb44f6232e9e"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "300ded82f010af0ab5753c344604c9f0"
server_key_iv: "a4f287969969190f698b748beb5b2cf7"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.769052 25445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260928 13:07:21.769837 25460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:21.770010 25445 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:21.770138 25445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "504f0997d6a249e9b442cb44f6232e9e"
format_stamp: "Formatted at 2026-09-28 13:07:21 on dist-test-slave-ddvw"
server_key: "300ded82f010af0ab5753c344604c9f0"
server_key_iv: "a4f287969969190f698b748beb5b2cf7"
server_key_version: "encryptionkey@0"
I20260928 13:07:21.770219 25445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:21.777263 25438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } attempt: 2
I20260928 13:07:21.777702 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.777566 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57610)
0928 13:07:21.777632 (+    66us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.777674 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 13:07:21.778045 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.777951 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57614)
0928 13:07:21.777997 (+    46us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.778021 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 13:07:21.778159 25438 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:43461: Network error: Client connection negotiation failed: client connection to 127.3.6.60:43461: connect: Connection refused (error 111)
I20260928 13:07:21.788251 25445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:21.790099 25445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:21.790261 25445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:21.794422 25445 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.60:43461
I20260928 13:07:21.794458 25512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.60:43461 every 8 connection(s)
I20260928 13:07:21.794806 25445 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
I20260928 13:07:21.795804 25513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:21.797248 25513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:21.804294  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25445
I20260928 13:07:21.804388  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790600576430005-3096-0/minicluster-data/master-2/wal/instance
I20260928 13:07:21.804596  3096 external_mini_cluster.cc:1428] Setting key 1a27c7a8da3a85209f5f161e6c2ee3da
I20260928 13:07:21.805775 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.797854 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42536 (local address 127.3.6.62:37117)
0928 13:07:21.797940 (+    86us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.797943 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.798126 (+   183us) server_negotiation.cc:407] Connection header received
0928 13:07:21.798541 (+   415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.798542 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.798551 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.798616 (+    65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.799237 (+   621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.799697 (+   460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.800606 (+   909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.800775 (+   169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.800825 (+    50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.802963 (+  2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.802964 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.802964 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.802969 (+     5us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.804207 (+  1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.804682 (+   475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.804684 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.804684 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.804744 (+    60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.805014 (+   270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.805015 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.805015 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.805190 (+   175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.805258 (+    68us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.805651 (+   393us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.805714 (+    63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260928 13:07:21.806039 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.797804 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:37117 (local address 127.0.0.1:42536)
0928 13:07:21.797995 (+   191us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.798029 (+    34us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.798459 (+   430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.798667 (+   208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.798669 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.798896 (+   227us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.799160 (+   264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.799165 (+     5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.799772 (+   607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.799773 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.800527 (+   754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.800529 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.800834 (+   305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.800853 (+    19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.800954 (+   101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.801468 (+   514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.801476 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.802881 (+  1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.804305 (+  1424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.804311 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.804313 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.804591 (+   278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.804813 (+   222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.804814 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.804814 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.804946 (+   132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.805287 (+   341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.805293 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.805476 (+   183us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.805609 (+   133us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.805779 (+   170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":99,"threads_started":1}
I20260928 13:07:21.806598 25513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:21.814047 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.806829 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:44171 (local address 127.0.0.1:60176)
0928 13:07:21.806874 (+    45us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.806885 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.806940 (+    55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.807150 (+   210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.807151 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.807279 (+   128us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.807322 (+    43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.807324 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.808242 (+   918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.808243 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.808992 (+   749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.808996 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.809446 (+   450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.809448 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.809496 (+    48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.809890 (+   394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.809895 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.811450 (+  1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.812955 (+  1505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.812955 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.812956 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.813155 (+   199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.813351 (+   196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.813352 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.813352 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.813431 (+    79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.813742 (+   311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.813743 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.813782 (+    39us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.813863 (+    81us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.813946 (+    83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:07:21.814060 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.806907 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60176 (local address 127.3.6.61:44171)
0928 13:07:21.806987 (+    80us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.806989 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.806998 (+     9us) server_negotiation.cc:407] Connection header received
0928 13:07:21.807043 (+    45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.807044 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.807054 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.807146 (+    92us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.807428 (+   282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.808146 (+   718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.809078 (+   932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.809367 (+   289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.809443 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.811536 (+  2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.811537 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.811537 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.811543 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.812870 (+  1327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.813224 (+   354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.813225 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.813226 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.813284 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.813513 (+   229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.813513 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.813514 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.813672 (+   158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.813731 (+    59us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.813892 (+   161us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.813972 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 13:07:21.814268 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.804996 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57630 (local address 127.3.6.60:43461)
0928 13:07:21.805160 (+   164us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.805169 (+     9us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.805231 (+    62us) server_negotiation.cc:407] Connection header received
0928 13:07:21.805309 (+    78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.805310 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.805320 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.805381 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.806334 (+   953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.807307 (+   973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.808314 (+  1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.808736 (+   422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.808809 (+    73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.811173 (+  2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.811180 (+     7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.811180 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.811187 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.812968 (+  1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.813359 (+   391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.813361 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.813362 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.813439 (+    77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.813645 (+   206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.813646 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.813646 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.813807 (+   161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.813944 (+   137us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.814028 (+    84us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.814141 (+   113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
I20260928 13:07:21.814659 25513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:21.821843 25515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.814902 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57640)
0928 13:07:21.814950 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.814960 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.814996 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.815273 (+   277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.815273 (+     0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.815425 (+   152us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.815457 (+    32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.815459 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.816046 (+   587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.816047 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.816506 (+   459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.816507 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.816883 (+   376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.816885 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.816932 (+    47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.817341 (+   409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.817346 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.819098 (+  1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.820720 (+  1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.820721 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.820722 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.820948 (+   226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.821185 (+   237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.821185 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.821186 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.821236 (+    50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.821504 (+   268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.821505 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.821551 (+    46us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.821618 (+    67us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.821728 (+   110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 13:07:21.821848 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.814950 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57640 (local address 127.3.6.60:43461)
0928 13:07:21.815115 (+   165us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.815117 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.815124 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:07:21.815141 (+    17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.815141 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.815153 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.815234 (+    81us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.815511 (+   277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.815969 (+   458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.816589 (+   620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.816801 (+   212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.816885 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.819187 (+  2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.819189 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.819189 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.819197 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.820640 (+  1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.821021 (+   381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.821022 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.821022 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.821111 (+    89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.821299 (+   188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.821300 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.821301 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.821441 (+   140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.821510 (+    69us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.821667 (+   157us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.821773 (+   106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":36,"server-negotiator.queue_time_us":18}
I20260928 13:07:21.822233 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.815296 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42548 (local address 127.3.6.62:37117)
0928 13:07:21.815343 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.815345 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.815352 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:07:21.815373 (+    21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.815374 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.815383 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.815444 (+    61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.815859 (+   415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.816310 (+   451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.816963 (+   653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.817175 (+   212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.817250 (+    75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.819321 (+  2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.819323 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.819323 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.819331 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.821026 (+  1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.821397 (+   371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.821398 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.821398 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.821445 (+    47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.821691 (+   246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.821692 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.821693 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.821828 (+   135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.822026 (+   198us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.822068 (+    42us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.822152 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 13:07:21.823699 25513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: Bootstrap starting.
I20260928 13:07:21.824652 25513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:21.824968 25513 log.cc:824] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:21.825742 25513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: No bootstrap required, opened a new log
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:21.827795 25513 raft_consensus.cc:348] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.827971 25513 raft_consensus.cc:729] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504f0997d6a249e9b442cb44f6232e9e, State: Initialized, Role: FOLLOWER
I20260928 13:07:21.828060 25513 consensus_queue.cc:260] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.828405 25513 sys_catalog.cc:564] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:21.828533 25519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.828661 25519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:07:21.830538 25530 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:21.830590 25530 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:21.831058 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.823035 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60184 (local address 127.3.6.61:44171)
0928 13:07:21.823086 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.823088 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.823123 (+    35us) server_negotiation.cc:407] Connection header received
0928 13:07:21.823190 (+    67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.823191 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.823201 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.823252 (+    51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.823689 (+   437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.824407 (+   718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.825112 (+   705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.825327 (+   215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.825412 (+    85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.827896 (+  2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.827897 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.827898 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.827905 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.829844 (+  1939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.830243 (+   399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.830245 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.830245 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.830310 (+    65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.830525 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.830526 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.830526 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.830667 (+   141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.830824 (+   157us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.830866 (+    42us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.830946 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:07:21.831094 25363 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } attempt: 2
I20260928 13:07:21.832291  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:21.830585 25445 master_runner.cc:186] Error getting master registration for 127.3.6.62:37117: OK, instance_id { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" instance_seqno: 1790600841486473 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:07:21.833573 25445 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:07:21.833624 25337 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5b1cf07783374f8ca5d4442288d29df1"
 from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42548
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:07:21.838853 25365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.831349 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57646)
0928 13:07:21.831397 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.831407 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.831440 (+    33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.831739 (+   299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.831741 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.831932 (+   191us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.831984 (+    52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.831986 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.832878 (+   892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.832879 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.833644 (+   765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.833647 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.834112 (+   465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.834115 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.834173 (+    58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.834669 (+   496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.834675 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.835952 (+  1277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.837725 (+  1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.837727 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.837727 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.837951 (+   224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.838160 (+   209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.838161 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.838162 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.838232 (+    70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.838529 (+   297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.838530 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.838580 (+    50us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.838657 (+    77us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.838753 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 13:07:21.838864 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.831547 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57646 (local address 127.3.6.60:43461)
0928 13:07:21.831602 (+    55us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.831604 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.831611 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:07:21.831629 (+    18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.831630 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.831638 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.831691 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.832070 (+   379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.832782 (+   712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.833747 (+   965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.834031 (+   284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.834100 (+    69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.836048 (+  1948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.836049 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.836050 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.836056 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.837637 (+  1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.838029 (+   392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.838030 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.838030 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.838086 (+    56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.838301 (+   215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.838301 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.838302 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.838455 (+   153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.838521 (+    66us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.838690 (+   169us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.838770 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 13:07:21.840481 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1: Bootstrap starting.
I20260928 13:07:21.841238 25363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:21.841547 25363 log.cc:824] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:21.842423 25363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1: No bootstrap required, opened a new log
I20260928 13:07:21.843891 25363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.844049 25363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b1cf07783374f8ca5d4442288d29df1, State: Initialized, Role: FOLLOWER
I20260928 13:07:21.844139 25363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.844465 25363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:21.844491 25337 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260928 13:07:21.844537 25337 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:21.845428 25337 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.845701 25337 leader_election.cc:288] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [CANDIDATE]: Term 1 election: Requested vote from peers d938f758518041f09d72bd56d74a170a (127.3.6.61:44171), 504f0997d6a249e9b442cb44f6232e9e (127.3.6.60:43461)
I20260928 13:07:21.844434 25533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.846045 25533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:21.846019 25487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b1cf07783374f8ca5d4442288d29df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "504f0997d6a249e9b442cb44f6232e9e"
I20260928 13:07:21.846163 25487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:21.847261 25487 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b1cf07783374f8ca5d4442288d29df1 in term 1.
I20260928 13:07:21.847505 25314 leader_election.cc:302] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504f0997d6a249e9b442cb44f6232e9e, 5b1cf07783374f8ca5d4442288d29df1; no voters: 
I20260928 13:07:21.847644 25533 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:21.847820 25533 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [term 1 LEADER]: Becoming Leader. State: Replica: 5b1cf07783374f8ca5d4442288d29df1, State: Running, Role: LEADER
I20260928 13:07:21.847909 25533 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.848304 25533 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1cf07783374f8ca5d4442288d29df1. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.848378 25533 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:21.849989 25295 master_runner.cc:186] Error getting master registration for 127.3.6.61:44171: OK, instance_id { permanent_uuid: "d938f758518041f09d72bd56d74a170a" instance_seqno: 1790600841632951 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:07:21.853216 25295 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:07:21.848701 25553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:21.854303 25553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:21.856995 25487 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [term 1 FOLLOWER]: Refusing update from remote peer 5b1cf07783374f8ca5d4442288d29df1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:07:21.857479 25551 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:07:21.857774 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.846853 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42564 (local address 127.3.6.62:37117)
0928 13:07:21.847097 (+   244us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.847099 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.847549 (+   450us) server_negotiation.cc:407] Connection header received
0928 13:07:21.847879 (+   330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.847881 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.847893 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.847927 (+    34us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.849237 (+  1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.849974 (+   737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.851055 (+  1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.851361 (+   306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.851403 (+    42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.853085 (+  1682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.853086 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.853086 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.853093 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.854773 (+  1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.856668 (+  1895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.856669 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.856670 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.856731 (+    61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.856960 (+   229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.856961 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.856961 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.857095 (+   134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.857186 (+    91us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.857611 (+   425us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.857693 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210}
I20260928 13:07:21.859561 25519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1cf07783374f8ca5d4442288d29df1. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.859653 25519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:21.861644 25551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.861747 25551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:21.862291 25519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.862380 25519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:21.862685 25556 mvcc.cc:205] Tried to move back new op lower bound from 7334301048242753536 to 7334301048209739776. Current Snapshot: MvccSnapshot[applied={T|T < 7334301048242753536}]
I20260928 13:07:21.863715 25553 catalog_manager.cc:1347] Generated new cluster ID: 7c4a002f07e14df38265b9c7e5704bb8
I20260928 13:07:21.863768 25553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:21.864629 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.847504 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.3.6.60:43461)
0928 13:07:21.847664 (+   160us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.847666 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.855184 (+  7518us) server_negotiation.cc:407] Connection header received
0928 13:07:21.855303 (+   119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.855304 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.855315 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.855344 (+    29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.855994 (+   650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.856680 (+   686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.857726 (+  1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.858013 (+   287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.858056 (+    43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.859510 (+  1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.859511 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.859512 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.859521 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.861820 (+  2299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.862529 (+   709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.862530 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.862530 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.862613 (+    83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.863306 (+   693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.863307 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.863308 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.863452 (+   144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.863538 (+    86us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.864458 (+   920us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.864536 (+    78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260928 13:07:21.865676 25442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.847144 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60194 (local address 127.3.6.61:44171)
0928 13:07:21.847196 (+    52us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.847198 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.848213 (+  1015us) server_negotiation.cc:407] Connection header received
0928 13:07:21.848315 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.848316 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.848328 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.848360 (+    32us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.849693 (+  1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.850365 (+   672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.851442 (+  1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.851747 (+   305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.851788 (+    41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.853585 (+  1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.853586 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.853586 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.853594 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.856596 (+  3002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.863139 (+  6543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.863151 (+    12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.863151 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.863218 (+    67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.864019 (+   801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.864020 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.864021 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.864165 (+   144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.864239 (+    74us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.865495 (+  1256us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.865588 (+    93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:07:21.866988 25557 mvcc.cc:205] Tried to move back new op lower bound from 7334301048242753536 to 7334301048209739776. Current Snapshot: MvccSnapshot[applied={T|T < 7334301048242753536}]
I20260928 13:07:21.869285 25438 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } attempt: 3
Sep 28 13:07:21 dist-test-slave-ddvw krb5kdc[25282](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600841, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:07:21.878660 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.869511 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:43461 (local address 127.0.0.1:57674)
0928 13:07:21.869618 (+   107us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:21.869628 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:21.869663 (+    35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:21.869910 (+   247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:21.869911 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:21.870071 (+   160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:21.870114 (+    43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.870115 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.870989 (+   874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.870989 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.871877 (+   888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:21.871879 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.872401 (+   522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.872404 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:21.872470 (+    66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.873080 (+   610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:21.873086 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:21.875549 (+  2463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:21.877534 (+  1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.877535 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.877536 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.877757 (+   221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.877979 (+   222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:21.877979 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:21.877980 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:21.878045 (+    65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:21.878336 (+   291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:21.878336 (+     0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:21.878392 (+    56us) client_negotiation.cc:769] Sending connection context
0928 13:07:21.878450 (+    58us) client_negotiation.cc:240] Negotiation successful
0928 13:07:21.878546 (+    96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260928 13:07:21.879046 25517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:21.869748 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57674 (local address 127.3.6.60:43461)
0928 13:07:21.869796 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.869798 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.869804 (+     6us) server_negotiation.cc:407] Connection header received
0928 13:07:21.869825 (+    21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.869826 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.869834 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.869874 (+    40us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.870179 (+   305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.870901 (+   722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.871986 (+  1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:21.872285 (+   299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:21.872339 (+    54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:21.875652 (+  3313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:21.875653 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:21.875653 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:21.875660 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:21.877438 (+  1778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.877837 (+   399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.877838 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.877839 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.877903 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:21.878117 (+   214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:21.878118 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:21.878119 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:21.878252 (+   133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:21.878302 (+    50us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:21.878868 (+   566us) server_negotiation.cc:299] Negotiation successful
0928 13:07:21.878945 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 13:07:21.880535 25438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: Bootstrap starting.
I20260928 13:07:21.881253 25438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:21.881567 25438 log.cc:824] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:21.887663 25438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: No bootstrap required, opened a new log
I20260928 13:07:21.888489 25553 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:21.889364 25553 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:21.889876 25438 raft_consensus.cc:348] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.890024 25438 raft_consensus.cc:729] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d938f758518041f09d72bd56d74a170a, State: Initialized, Role: FOLLOWER
I20260928 13:07:21.890107 25438 consensus_queue.cc:260] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } }
I20260928 13:07:21.890419 25438 sys_catalog.cc:564] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:21.890450 25412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5b1cf07783374f8ca5d4442288d29df1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d938f758518041f09d72bd56d74a170a"
I20260928 13:07:21.890560 25412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:21.891371 25412 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b1cf07783374f8ca5d4442288d29df1 in term 1.
I20260928 13:07:21.891546 25411 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [term 1 FOLLOWER]: Refusing update from remote peer 5b1cf07783374f8ca5d4442288d29df1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:07:21.891933 25551 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:07:21.894243 25562 sys_catalog.cc:455] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.894387 25562 sys_catalog.cc:458] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:21.894483 25562 sys_catalog.cc:455] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1cf07783374f8ca5d4442288d29df1. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.894600 25562 sys_catalog.cc:458] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:21.894678 25562 sys_catalog.cc:455] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.894779 25562 sys_catalog.cc:458] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a [sys.catalog]: This master's current role is: FOLLOWER
W20260928 13:07:21.895853 25573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:21.895910 25573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:21.899917 25575 mvcc.cc:205] Tried to move back new op lower bound from 7334301048370499584 to 7334301048209739776. Current Snapshot: MvccSnapshot[applied={T|T < 7334301048242753536}]
I20260928 13:07:21.902711 25551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b1cf07783374f8ca5d4442288d29df1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b1cf07783374f8ca5d4442288d29df1" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 37117 } } peers { permanent_uuid: "d938f758518041f09d72bd56d74a170a" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 44171 } } peers { permanent_uuid: "504f0997d6a249e9b442cb44f6232e9e" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 43461 } } }
I20260928 13:07:21.902827 25551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:21.904078 25553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b1cf07783374f8ca5d4442288d29df1: Generated new TSK 0
I20260928 13:07:21.904243 25553 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 13:07:21.927045 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.925271 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60196 (local address 127.3.6.61:44171)
0928 13:07:21.925318 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.925320 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.926260 (+   940us) server_negotiation.cc:407] Connection header received
0928 13:07:21.926368 (+   108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.926370 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.926383 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.926414 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.926911 (+   497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60196: BlockingRecv error: recv got EOF from 127.0.0.1:60196 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260928 13:07:21.927821 25517 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.925632 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57684 (local address 127.3.6.60:43461)
0928 13:07:21.925671 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.925673 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.927297 (+  1624us) server_negotiation.cc:407] Connection header received
0928 13:07:21.927404 (+   107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.927405 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.927416 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.927447 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.927762 (+   315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57684: BlockingRecv error: recv got EOF from 127.0.0.1:57684 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 13:07:21.928570 25366 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.925965 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42566 (local address 127.3.6.62:37117)
0928 13:07:21.926006 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.926008 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.928032 (+  2024us) server_negotiation.cc:407] Connection header received
0928 13:07:21.928130 (+    98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.928131 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.928142 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.928173 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.928502 (+   329us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42566: BlockingRecv error: recv got EOF from 127.0.0.1:42566 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260928 13:07:21.935838 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.931676 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60210 (local address 127.3.6.61:44171)
0928 13:07:21.931723 (+    47us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.931725 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.935229 (+  3504us) server_negotiation.cc:407] Connection header received
0928 13:07:21.935351 (+   122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.935352 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.935373 (+    21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.935404 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.935779 (+   375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60210: BlockingRecv error: recv got EOF from 127.0.0.1:60210 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260928 13:07:21.938867 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.938071 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60220 (local address 127.3.6.61:44171)
0928 13:07:21.938106 (+    35us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.938108 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.938360 (+   252us) server_negotiation.cc:407] Connection header received
0928 13:07:21.938455 (+    95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.938455 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.938465 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.938494 (+    29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.938818 (+   324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60220: BlockingRecv error: recv got EOF from 127.0.0.1:60220 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 13:07:21.942651 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.941907 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60226 (local address 127.3.6.61:44171)
0928 13:07:21.941939 (+    32us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.941941 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.942159 (+   218us) server_negotiation.cc:407] Connection header received
0928 13:07:21.942247 (+    88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.942247 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.942257 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.942283 (+    26us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.942605 (+   322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60226: BlockingRecv error: recv got EOF from 127.0.0.1:60226 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260928 13:07:21.948696 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.947840 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60230 (local address 127.3.6.61:44171)
0928 13:07:21.947879 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.947881 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.948140 (+   259us) server_negotiation.cc:407] Connection header received
0928 13:07:21.948243 (+   103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.948244 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.948255 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.948286 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.948645 (+   359us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60230: BlockingRecv error: recv got EOF from 127.0.0.1:60230 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 13:07:21.958930 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.957972 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60246 (local address 127.3.6.61:44171)
0928 13:07:21.958018 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.958020 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.958313 (+   293us) server_negotiation.cc:407] Connection header received
0928 13:07:21.958426 (+   113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.958427 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.958439 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.958470 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.958860 (+   390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60246: BlockingRecv error: recv got EOF from 127.0.0.1:60246 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 13:07:21.977239 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:21.976285 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60258 (local address 127.3.6.61:44171)
0928 13:07:21.976329 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:21.976332 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:21.976636 (+   304us) server_negotiation.cc:407] Connection header received
0928 13:07:21.976745 (+   109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:21.976747 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:21.976759 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:21.976790 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:21.977181 (+   391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60258: BlockingRecv error: recv got EOF from 127.0.0.1:60258 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 13:07:22.011709 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:22.010560 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60264 (local address 127.3.6.61:44171)
0928 13:07:22.010615 (+    55us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.010632 (+    17us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.010949 (+   317us) server_negotiation.cc:407] Connection header received
0928 13:07:22.011110 (+   161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.011112 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.011125 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.011163 (+    38us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:22.011645 (+   482us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60264: BlockingRecv error: recv got EOF from 127.0.0.1:60264 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260928 13:07:22.077741 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:22.077067 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60266 (local address 127.3.6.61:44171)
0928 13:07:22.077120 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.077122 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.077210 (+    88us) server_negotiation.cc:407] Connection header received
0928 13:07:22.077254 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.077255 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.077266 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.077320 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:22.077692 (+   372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60266: BlockingRecv error: recv got EOF from 127.0.0.1:60266 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260928 13:07:22.207542 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:22.206872 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.3.6.61:44171)
0928 13:07:22.206930 (+    58us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.206932 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.207026 (+    94us) server_negotiation.cc:407] Connection header received
0928 13:07:22.207128 (+   102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.207129 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.207139 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.207192 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:22.207494 (+   302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60268: BlockingRecv error: recv got EOF from 127.0.0.1:60268 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260928 13:07:22.465580 25442 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:22.464778 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60282 (local address 127.3.6.61:44171)
0928 13:07:22.464828 (+    50us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.464830 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.464969 (+   139us) server_negotiation.cc:407] Connection header received
0928 13:07:22.465045 (+    76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.465046 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.465069 (+    23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.465138 (+    69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:22.465507 (+   369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60282: BlockingRecv error: recv got EOF from 127.0.0.1:60282 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:07:22.831087 25530 catalog_manager.cc:1259] Loaded cluster ID: 7c4a002f07e14df38265b9c7e5704bb8
I20260928 13:07:22.831169 25530 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: loading cluster ID for follower catalog manager: success
I20260928 13:07:22.831916 25530 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: acquiring CA information for follower catalog manager: success
I20260928 13:07:22.832228 25530 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 504f0997d6a249e9b442cb44f6232e9e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:07:22.896458 25573 catalog_manager.cc:1259] Loaded cluster ID: 7c4a002f07e14df38265b9c7e5704bb8
I20260928 13:07:22.896540 25573 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: loading cluster ID for follower catalog manager: success
I20260928 13:07:22.897732 25573 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: acquiring CA information for follower catalog manager: success
I20260928 13:07:22.898092 25573 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d938f758518041f09d72bd56d74a170a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:07:22.981331 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:22.978793 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.3.6.61:44171)
0928 13:07:22.978927 (+   134us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.978929 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.978942 (+    13us) server_negotiation.cc:407] Connection header received
0928 13:07:22.978986 (+    44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.978987 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.979095 (+   108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.979167 (+    72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:22.979315 (+   148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.979817 (+   502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.980557 (+   740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.980749 (+   192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.980802 (+    53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:22.980947 (+   145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:22.981062 (+   115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:22.981134 (+    72us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:22.981187 (+    53us) server_negotiation.cc:299] Negotiation successful
0928 13:07:22.981206 (+    19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260928 13:07:22.985560 25652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:22.983254 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.3.6.60:43461)
0928 13:07:22.983357 (+   103us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.983358 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.983368 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:07:22.983404 (+    36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.983405 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.983438 (+    33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.983507 (+    69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:22.983593 (+    86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.984095 (+   502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.984797 (+   702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.984996 (+   199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.985103 (+   107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:22.985225 (+   122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:22.985331 (+   106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:22.985389 (+    58us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:22.985417 (+    28us) server_negotiation.cc:299] Negotiation successful
0928 13:07:22.985436 (+    19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":57,"threads_started":1}
I20260928 13:07:22.990433 25652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:22.987755 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.3.6.60:43461)
0928 13:07:22.987797 (+    42us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.987799 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.987935 (+   136us) server_negotiation.cc:407] Connection header received
0928 13:07:22.988014 (+    79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.988015 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.988027 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.988078 (+    51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:22.988192 (+   114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.988872 (+   680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.989617 (+   745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.989919 (+   302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.989981 (+    62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:22.990147 (+   166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:22.990182 (+    35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:22.990233 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:22.990326 (+    93us) server_negotiation.cc:299] Negotiation successful
0928 13:07:22.990351 (+    25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:07:22.990453 25646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:22.987429 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60298 (local address 127.3.6.61:44171)
0928 13:07:22.987482 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.987484 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.987632 (+   148us) server_negotiation.cc:407] Connection header received
0928 13:07:22.987704 (+    72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.987705 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.987715 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.987764 (+    49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:22.987938 (+   174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.988714 (+   776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.989706 (+   992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.989980 (+   274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.990023 (+    43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:22.990199 (+   176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:22.990230 (+    31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:22.990281 (+    51us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:22.990346 (+    65us) server_negotiation.cc:299] Negotiation successful
0928 13:07:22.990370 (+    24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 13:07:22.990870 25658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:22.987423 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42574 (local address 127.3.6.62:37117)
0928 13:07:22.987537 (+   114us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:22.987539 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:22.987562 (+    23us) server_negotiation.cc:407] Connection header received
0928 13:07:22.987689 (+   127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:22.987690 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:22.987749 (+    59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:22.987842 (+    93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:22.988037 (+   195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.988616 (+   579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.989697 (+  1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:22.990024 (+   327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:22.990084 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:22.990290 (+   206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:22.990404 (+   114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:22.990466 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:22.990750 (+   284us) server_negotiation.cc:299] Negotiation successful
0928 13:07:22.990787 (+    37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":49,"threads_started":1}
I20260928 13:07:22.992672  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25295
I20260928 13:07:22.997923  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25370
I20260928 13:07:23.003113  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25445
2026-09-28T13:07:23Z chronyd exiting
[       OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2802 ms)
[ RUN      ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 13:07:23 dist-test-slave-ddvw krb5kdc[25663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 13:07:23 dist-test-slave-ddvw krb5kdc[25663](info): set up 2 sockets
Sep 28 13:07:23 dist-test-slave-ddvw krb5kdc[25663](info): commencing operation
krb5kdc: starting...
W20260928 13:07:24.039345  3096 mini_kdc.cc:121] Time spent starting KDC: real 1.016s	user 0.000s	sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/test-user.keytab.
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM: 
2026-09-28T13:07:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T13:07:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.3.6.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
Entry for principal kudu/127.3.6.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab.
I20260928 13:07:24.156236  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42981
--webserver_interface=127.3.6.62
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:40171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 13:07:24.239444 25676 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:24.239661 25676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:24.239679 25676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:24.239737 25676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:24.240919 25676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:24.240960 25676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:24.240974 25676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:24.240988 25676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:24.241047 25676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:24.242514 25676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:40171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.62.keytab
--principal=kudu/127.3.6.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.62:42981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.3.6.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:24.242775 25676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:24.243062 25676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:24.248046 25682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:24.248076 25684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:24.248046 25681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:24.248199 25676 server_base.cc:1034] running on GCE node
I20260928 13:07:24.248484 25676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:24.248795 25676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:24.249957 25676 hybrid_clock.cc:648] HybridClock initialized: now 1790600844249944 us; error 46 us; skew 500 ppm
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:24.252471 25676 init.cc:377] Logged in from keytab as kudu/127.3.6.62@KRBTEST.COM (short username kudu)
I20260928 13:07:24.252938 25676 webserver.cc:460] Webserver started at http://127.3.6.62:37755/ using document root <none> and password file <none>
I20260928 13:07:24.253142 25676 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:24.253183 25676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:24.253271 25676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:24.254293 25676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data/instance:
uuid: "2e39da680b444105a1555773c17c4ce9"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "34b0033e7bcb33e740e04412500ce95e"
server_key_iv: "6995751c01813b2a5f285c8e1e3438fb"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.254596 25676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance:
uuid: "2e39da680b444105a1555773c17c4ce9"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "34b0033e7bcb33e740e04412500ce95e"
server_key_iv: "6995751c01813b2a5f285c8e1e3438fb"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.255937 25676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.003s
I20260928 13:07:24.256659 25691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:24.256883 25676 fs_manager.cc:725] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260928 13:07:24.256981 25676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal
uuid: "2e39da680b444105a1555773c17c4ce9"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "34b0033e7bcb33e740e04412500ce95e"
server_key_iv: "6995751c01813b2a5f285c8e1e3438fb"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.257085 25676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:24.271497 25676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:24.273519 25676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:24.273667 25676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:24.277890 25676 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.62:42981
I20260928 13:07:24.277953 25743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.62:42981 every 8 connection(s)
I20260928 13:07:24.278308 25676 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/data/info.pb
I20260928 13:07:24.279255 25744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:24.280797 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:24.281287  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25676
I20260928 13:07:24.281414  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-0/wal/instance
I20260928 13:07:24.281630  3096 external_mini_cluster.cc:1428] Setting key 1e9a291451e119cd6aca6e387a26c374
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.3.6.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.61@KRBTEST.COM" created.
I20260928 13:07:24.292537 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.281584 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49614 (local address 127.3.6.62:42981)
0928 13:07:24.282560 (+   976us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.282564 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.282579 (+    15us) server_negotiation.cc:407] Connection header received
0928 13:07:24.282655 (+    76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.282657 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.282677 (+    20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.282772 (+    95us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.283653 (+   881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.284953 (+  1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.285912 (+   959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.286479 (+   567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.286606 (+   127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.289029 (+  2423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.289038 (+     9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.289038 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.289047 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.290755 (+  1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.291235 (+   480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.291238 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.291238 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.291329 (+    91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.291574 (+   245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.291574 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.291575 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.291854 (+   279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.291933 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.292209 (+   276us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.292370 (+   161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":951,"thread_start_us":73,"threads_started":1}
I20260928 13:07:24.292552 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.281558 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42981 (local address 127.0.0.1:49614)
0928 13:07:24.281755 (+   197us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.281796 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.282398 (+   602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.282890 (+   492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.282893 (+     3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.283291 (+   398us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.283518 (+   227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.283525 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.285064 (+  1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.285065 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.285819 (+   754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.285821 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.286570 (+   749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.286597 (+    27us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.286651 (+    54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.287260 (+   609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.287268 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.288931 (+  1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.290830 (+  1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.290836 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.290838 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.291148 (+   310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.291420 (+   272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.291421 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.291421 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.291509 (+    88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.291994 (+   485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.292006 (+    12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.292064 (+    58us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.292134 (+    70us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.292313 (+   179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":91,"threads_started":1}
I20260928 13:07:24.293345 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:24.293705 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.293581 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41442)
0928 13:07:24.293631 (+    50us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.293680 (+    49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260928 13:07:24.293839 25692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
I20260928 13:07:24.294265 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.294171 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41450)
0928 13:07:24.294219 (+    48us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.294242 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 13:07:24.294356 25744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:42033: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
Entry for principal kudu/127.3.6.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab.
I20260928 13:07:24.306102  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:42033
--webserver_interface=127.3.6.61
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:40171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:07:24.343650 25744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } attempt: 1
I20260928 13:07:24.344317 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.344163 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41462)
0928 13:07:24.344230 (+    67us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.344282 (+    52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 13:07:24.344712 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.344620 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41464)
0928 13:07:24.344663 (+    43us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.344691 (+    28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260928 13:07:24.344810 25744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:42033: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
W20260928 13:07:24.388381 25751 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:24.388577 25751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:24.388594 25751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:24.388613 25751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 13:07:24.389678 25751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:24.389709 25751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:24.389724 25751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:24.389735 25751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:24.389755 25751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:24.391167 25751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:40171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.61.keytab
--principal=kudu/127.3.6.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.61:42033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.3.6.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:24.391352 25751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:24.391523 25751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:24.396123 25756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:24.396163 25757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:24.396178 25759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:24.396373 25751 server_base.cc:1034] running on GCE node
I20260928 13:07:24.396651 25751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:24.396930 25751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:24.398074 25751 hybrid_clock.cc:648] HybridClock initialized: now 1790600844398065 us; error 28 us; skew 500 ppm
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:24.400671 25751 init.cc:377] Logged in from keytab as kudu/127.3.6.61@KRBTEST.COM (short username kudu)
I20260928 13:07:24.401141 25751 webserver.cc:460] Webserver started at http://127.3.6.61:33077/ using document root <none> and password file <none>
I20260928 13:07:24.401357 25751 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:24.401404 25751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:24.401575 25751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:24.402635 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data/instance:
uuid: "6a24a9bd62db4849bf46325c69f68dec"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "a5b4a8b3c99c2c9df4ba284507da6815"
server_key_iv: "0e28a7f93ebed1dbad811fd9f068ba83"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.402992 25751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal/instance:
uuid: "6a24a9bd62db4849bf46325c69f68dec"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "a5b4a8b3c99c2c9df4ba284507da6815"
server_key_iv: "0e28a7f93ebed1dbad811fd9f068ba83"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.404333 25751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260928 13:07:24.405054 25766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:24.405241 25751 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.001s	sys 0.000s
I20260928 13:07:24.405329 25751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal
uuid: "6a24a9bd62db4849bf46325c69f68dec"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "a5b4a8b3c99c2c9df4ba284507da6815"
server_key_iv: "0e28a7f93ebed1dbad811fd9f068ba83"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.405403 25751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:24.412941 25744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } attempt: 2
I20260928 13:07:24.413354 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.413232 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41468)
0928 13:07:24.413287 (+    55us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.413323 (+    36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 13:07:24.413694 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.413619 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41480)
0928 13:07:24.413659 (+    40us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.413680 (+    21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260928 13:07:24.413806 25744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.61:42033: Network error: Client connection negotiation failed: client connection to 127.3.6.61:42033: connect: Connection refused (error 111)
I20260928 13:07:24.419103 25751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:24.421526 25751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:24.421696 25751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:24.425738 25751 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.61:42033
I20260928 13:07:24.425769 25818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.61:42033 every 8 connection(s)
I20260928 13:07:24.426148 25751 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/data/info.pb
I20260928 13:07:24.427175 25819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:24.428706 25819 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:24.430598  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25751
I20260928 13:07:24.430706  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-1/wal/instance
I20260928 13:07:24.430908  3096 external_mini_cluster.cc:1428] Setting key 8f9e8299e3b606b7de90026f2df0423f
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:24.438517 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.429420 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49626 (local address 127.3.6.62:42981)
0928 13:07:24.429484 (+    64us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.429486 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.429693 (+   207us) server_negotiation.cc:407] Connection header received
0928 13:07:24.430138 (+   445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.430139 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.430151 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.430210 (+    59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.431118 (+   908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.431600 (+   482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.432849 (+  1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.433180 (+   331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.433256 (+    76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.435453 (+  2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.435454 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.435455 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.435464 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.437113 (+  1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.437497 (+   384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.437498 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.437499 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.437567 (+    68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.437798 (+   231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.437799 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.437800 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.437947 (+   147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.438025 (+    78us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.438301 (+   276us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.438400 (+    99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 13:07:24.438534 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.429393 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42981 (local address 127.0.0.1:49626)
0928 13:07:24.429567 (+   174us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.429608 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.430058 (+   450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.430282 (+   224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.430286 (+     4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.430627 (+   341us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.430937 (+   310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.430944 (+     7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.431695 (+   751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.431696 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.432751 (+  1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.432754 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.433262 (+   508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.433283 (+    21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.433392 (+   109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.433928 (+   536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.433936 (+     8us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.435349 (+  1413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.437194 (+  1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.437200 (+     6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.437202 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.437418 (+   216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.437636 (+   218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.437636 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.437636 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.437732 (+    96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.438039 (+   307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.438044 (+     5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.438160 (+   116us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.438247 (+    87us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.438366 (+   119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":103,"threads_started":1}
WARNING: no policy specified for kudu/127.3.6.60@KRBTEST.COM; defaulting to no policy
I20260928 13:07:24.439181 25819 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.3.6.60@KRBTEST.COM" created.
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:24.447314 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.439456 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41484)
0928 13:07:24.439505 (+    49us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.439516 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.439560 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.439785 (+   225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.439786 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.439921 (+   135us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.439979 (+    58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.439981 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.440897 (+   916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.440898 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.441543 (+   645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.441546 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.442050 (+   504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.442053 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.442136 (+    83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.442525 (+   389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.442530 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.444109 (+  1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.446233 (+  2124us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.446233 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.446234 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.446394 (+   160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.446621 (+   227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.446622 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.446622 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.446672 (+    50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.447082 (+   410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.447083 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.447119 (+    36us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.447173 (+    54us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.447244 (+    71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 13:07:24.447479 25823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.439546 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41484 (local address 127.3.6.61:42033)
0928 13:07:24.439664 (+   118us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.439668 (+     4us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.439682 (+    14us) server_negotiation.cc:407] Connection header received
0928 13:07:24.439697 (+    15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.439698 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.439708 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.439758 (+    50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.440092 (+   334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.440822 (+   730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.441619 (+   797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.441945 (+   326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.442010 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.444188 (+  2178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.444196 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.444197 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.444204 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.446140 (+  1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.446479 (+   339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.446483 (+     4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.446484 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.446550 (+    66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.446738 (+   188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.446739 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.446739 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.446961 (+   222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.447103 (+   142us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.447214 (+   111us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.447312 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":96,"thread_start_us":70,"threads_started":1}
I20260928 13:07:24.448094 25819 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:24.448441 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.448331 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55770)
0928 13:07:24.448378 (+    47us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.448420 (+    42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 13:07:24.448606 25767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
I20260928 13:07:24.448989 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.448926 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55774)
0928 13:07:24.448951 (+    25us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.448974 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260928 13:07:24.449141 25819 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:41677: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
Entry for principal kudu/127.3.6.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab.
I20260928 13:07:24.458640  3096 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasktCerZp/build/release/bin/kudu
/tmp/dist-test-tasktCerZp/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:41677
--webserver_interface=127.3.6.60
--webserver_port=0
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.3.6.20:40171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 13:07:24.498420 25819 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } attempt: 1
I20260928 13:07:24.498960 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.498784 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55786)
0928 13:07:24.498846 (+    62us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.498929 (+    83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 13:07:24.499338 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.499243 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55800)
0928 13:07:24.499288 (+    45us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.499312 (+    24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:07:24.499423 25819 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:41677: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
I20260928 13:07:24.504993 25744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } attempt: 3
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:24.512064 25823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.505374 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41494 (local address 127.3.6.61:42033)
0928 13:07:24.505449 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.505451 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.505461 (+    10us) server_negotiation.cc:407] Connection header received
0928 13:07:24.505509 (+    48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.505510 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.505528 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.505592 (+    64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.505903 (+   311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.506401 (+   498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.507273 (+   872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.507496 (+   223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.507580 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.509477 (+  1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.509478 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.509478 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.509485 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.510857 (+  1372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.511291 (+   434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.511292 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.511293 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.511350 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.511560 (+   210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.511560 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.511561 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.511669 (+   108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.511740 (+    71us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.511897 (+   157us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.511974 (+    77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260928 13:07:24.512070 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.505312 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41494)
0928 13:07:24.505377 (+    65us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.505386 (+     9us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.505447 (+    61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.505597 (+   150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.505598 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.505757 (+   159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.505820 (+    63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.505822 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.506490 (+   668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.506491 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.507145 (+   654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.507148 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.507575 (+   427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.507578 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.507663 (+    85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.508149 (+   486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.508153 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.509383 (+  1230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.511041 (+  1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.511043 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.511043 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.511217 (+   174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.511432 (+   215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.511433 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.511434 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.511497 (+    63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.511745 (+   248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.511746 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.511790 (+    44us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.511872 (+    82us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.511974 (+   102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 13:07:24.512537 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } has no permanent_uuid. Determining permanent_uuid...
I20260928 13:07:24.512866 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.512766 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55812)
0928 13:07:24.512815 (+    49us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.512844 (+    29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 13:07:24.513199 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.513114 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55820)
0928 13:07:24.513155 (+    41us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.513177 (+    22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260928 13:07:24.513299 25744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:41677: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
I20260928 13:07:24.544436 25744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } attempt: 1
W20260928 13:07:24.544636 25826 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 13:07:24.544898 25826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 13:07:24.544950 25826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 13:07:24.544983 25826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 13:07:24.544978 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.544788 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55836)
0928 13:07:24.544853 (+    65us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.544918 (+    65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 13:07:24.545367 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.545293 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55850)
0928 13:07:24.545330 (+    37us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.545353 (+    23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260928 13:07:24.545486 25744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:41677: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
W20260928 13:07:24.546384 25826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 13:07:24.546427 25826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 13:07:24.546442 25826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 13:07:24.546454 25826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 13:07:24.546502 25826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 13:07:24.548049 25826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.3.6.20:40171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.3.6.62:42981,127.3.6.61:42033,127.3.6.60:41677
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/krb5kdc/kudu_127.3.6.60.keytab
--principal=kudu/127.3.6.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.3.6.60:41677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.3.6.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 12:08:40 UTC on ccycloud.quasar-tlwibe.root.comops.site
build id 4677203
I20260928 13:07:24.548301 25826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 13:07:24.548538 25826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 13:07:24.553839 25834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 13:07:24.553818 25832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:24.554179 25826 server_base.cc:1034] running on GCE node
W20260928 13:07:24.554255 25831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 13:07:24.554518 25826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 13:07:24.554834 25826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 13:07:24.556034 25826 hybrid_clock.cc:648] HybridClock initialized: now 1790600844556012 us; error 42 us; skew 500 ppm
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 13:07:24.558615 25826 init.cc:377] Logged in from keytab as kudu/127.3.6.60@KRBTEST.COM (short username kudu)
I20260928 13:07:24.559173 25826 webserver.cc:460] Webserver started at http://127.3.6.60:43835/ using document root <none> and password file <none>
I20260928 13:07:24.559418 25826 fs_manager.cc:359] Metadata directory not provided
I20260928 13:07:24.559501 25826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 13:07:24.559660 25826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 13:07:24.560890 25826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data/instance:
uuid: "1bf93eb2e60646939960458377652516"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "e296a356dc429ebd2a5424a6822c9295"
server_key_iv: "18f698a8fc5d79b8dc59fc29590a85a6"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.561287 25826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal/instance:
uuid: "1bf93eb2e60646939960458377652516"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "e296a356dc429ebd2a5424a6822c9295"
server_key_iv: "18f698a8fc5d79b8dc59fc29590a85a6"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.562701 25826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s	user 0.003s	sys 0.000s
I20260928 13:07:24.563591 25841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:24.563766 25826 fs_manager.cc:725] Time spent opening block manager: real 0.000s	user 0.000s	sys 0.000s
I20260928 13:07:24.563881 25826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data,/tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal
uuid: "1bf93eb2e60646939960458377652516"
format_stamp: "Formatted at 2026-09-28 13:07:24 on dist-test-slave-ddvw"
server_key: "e296a356dc429ebd2a5424a6822c9295"
server_key_iv: "18f698a8fc5d79b8dc59fc29590a85a6"
server_key_version: "encryptionkey@0"
I20260928 13:07:24.563964 25826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 13:07:24.567575 25819 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } attempt: 2
I20260928 13:07:24.568053 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.567903 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55854)
0928 13:07:24.567979 (+    76us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.568019 (+    40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260928 13:07:24.568379 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.568293 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55856)
0928 13:07:24.568335 (+    42us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.568361 (+    26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 13:07:24.568475 25819 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.3.6.60:41677: Network error: Client connection negotiation failed: client connection to 127.3.6.60:41677: connect: Connection refused (error 111)
I20260928 13:07:24.585394 25826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260928 13:07:24.587597 25826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 13:07:24.587723 25826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 13:07:24.591709 25826 rpc_server.cc:307] RPC server started. Bound to: 127.3.6.60:41677
I20260928 13:07:24.591744 25893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.3.6.60:41677 every 8 connection(s)
I20260928 13:07:24.592125 25826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/data/info.pb
I20260928 13:07:24.593219 25894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 13:07:24.593631  3096 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasktCerZp/build/release/bin/kudu as pid 25826
I20260928 13:07:24.593740  3096 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasktCerZp/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790600576430005-3096-0/minicluster-data/master-2/wal/instance
I20260928 13:07:24.593951  3096 external_mini_cluster.cc:1428] Setting key c8bc897cf668b497007e0e8ca806b8bf
I20260928 13:07:24.595439 25894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:07:24.605038 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.596250 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49642 (local address 127.3.6.62:42981)
0928 13:07:24.596327 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.596330 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.596461 (+   131us) server_negotiation.cc:407] Connection header received
0928 13:07:24.596516 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.596517 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.596528 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.596580 (+    52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.597045 (+   465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.597707 (+   662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.598841 (+  1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.599145 (+   304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.599210 (+    65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.601568 (+  2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.601570 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.601571 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.601579 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.603335 (+  1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.603869 (+   534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.603870 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.603871 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.603967 (+    96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.604282 (+   315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.604283 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.604283 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.604439 (+   156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.604519 (+    80us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.604846 (+   327us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.604968 (+   122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 13:07:24.605222 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.596215 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.62:42981 (local address 127.0.0.1:49642)
0928 13:07:24.596351 (+   136us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.596392 (+    41us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.596457 (+    65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.596605 (+   148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.596607 (+     2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.596864 (+   257us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.596955 (+    91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.596959 (+     4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.597794 (+   835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.597795 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.598764 (+   969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.598767 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.599216 (+   449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.599247 (+    31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.599321 (+    74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.599835 (+   514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.599845 (+    10us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.601470 (+  1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.603415 (+  1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.603423 (+     8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.603425 (+     2us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.603774 (+   349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.604049 (+   275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.604050 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.604051 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.604187 (+   136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.604516 (+   329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.604522 (+     6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.604691 (+   169us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.604800 (+   109us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.604967 (+   167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":20,"thread_start_us":83,"threads_started":1}
I20260928 13:07:24.605785 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.594476 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55866 (local address 127.3.6.60:41677)
0928 13:07:24.594675 (+   199us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.594683 (+     8us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.594709 (+    26us) server_negotiation.cc:407] Connection header received
0928 13:07:24.595211 (+   502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.595219 (+     8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.595271 (+    52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.595395 (+   124us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.596223 (+   828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.597462 (+  1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.598521 (+  1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.598978 (+   457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.599116 (+   138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.602201 (+  3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.602209 (+     8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.602209 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.602218 (+     9us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.604199 (+  1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.604604 (+   405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.604607 (+     3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.604607 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.604665 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.604891 (+   226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.604891 (+     0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.604892 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.605048 (+   156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.605175 (+   127us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.605614 (+   439us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.605671 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":135,"thread_start_us":101,"threads_started":1}
I20260928 13:07:24.605912 25894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.62@KRBTEST.COM
I20260928 13:07:24.613667 25823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.606248 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41500 (local address 127.3.6.61:42033)
0928 13:07:24.606296 (+    48us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.606298 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.606306 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:07:24.606331 (+    25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.606332 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.606342 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.606391 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.606689 (+   298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.607348 (+   659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.608651 (+  1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.608876 (+   225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.608969 (+    93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.610857 (+  1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.610858 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.610858 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.610865 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.612477 (+  1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.612790 (+   313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.612791 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.612792 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.612849 (+    57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.613090 (+   241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.613091 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.613092 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.613244 (+   152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.613296 (+    52us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.613493 (+   197us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.613575 (+    82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 13:07:24.613684 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.606170 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.61:42033 (local address 127.0.0.1:41500)
0928 13:07:24.606223 (+    53us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.606234 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.606270 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.606392 (+   122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.606393 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.606543 (+   150us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.606602 (+    59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.606604 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.608043 (+  1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.608044 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.608544 (+   500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.608545 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.608967 (+   422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.608970 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.609040 (+    70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.609489 (+   449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.609494 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.610751 (+  1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.612560 (+  1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.612560 (+     0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.612561 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.612716 (+   155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.612978 (+   262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.612979 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.612979 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.613029 (+    50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.613323 (+   294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.613324 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.613372 (+    48us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.613463 (+    91us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.613558 (+    95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260928 13:07:24.614364 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.606733 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49652 (local address 127.3.6.62:42981)
0928 13:07:24.606770 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.606772 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.606793 (+    21us) server_negotiation.cc:407] Connection header received
0928 13:07:24.606847 (+    54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.606848 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.606856 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.606929 (+    73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.607456 (+   527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.607942 (+   486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.608691 (+   749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.608913 (+   222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.609066 (+   153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.611534 (+  2468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.611535 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.611535 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.611542 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.613121 (+  1579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.613486 (+   365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.613487 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.613487 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.613545 (+    58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.613851 (+   306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.613852 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.613852 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.614012 (+   160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.614185 (+   173us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.614220 (+    35us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.614277 (+    57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 13:07:24.614468 25894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.60@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.3.6.61@KRBTEST.COM
I20260928 13:07:24.620635 25744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } attempt: 2
I20260928 13:07:24.621994 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.614781 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.3.6.60:41677)
0928 13:07:24.614813 (+    32us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.614815 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.614822 (+     7us) server_negotiation.cc:407] Connection header received
0928 13:07:24.614877 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.614877 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.614886 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.614935 (+    49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.615256 (+   321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.615966 (+   710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.616817 (+   851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.617156 (+   339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.617234 (+    78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.618996 (+  1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.618997 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.618997 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.619003 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.620578 (+  1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.620974 (+   396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.620975 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.620975 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.621064 (+    89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.621487 (+   423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.621488 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.621489 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.621629 (+   140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.621672 (+    43us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.621857 (+   185us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.621931 (+    74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 13:07:24.622285 25898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.614721 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55878)
0928 13:07:24.614772 (+    51us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.614782 (+    10us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.614821 (+    39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.614944 (+   123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.614945 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.615128 (+   183us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.615165 (+    37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.615167 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.616035 (+   868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.616036 (+     1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.616733 (+   697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.616735 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.617232 (+   497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.617234 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.617269 (+    35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.617659 (+   390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.617665 (+     6us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.618922 (+  1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.620680 (+  1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.620681 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.620682 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.620895 (+   213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.621143 (+   248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.621144 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.621145 (+     1us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.621389 (+   244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.621716 (+   327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.621717 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.621753 (+    36us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.622121 (+   368us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.622208 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260928 13:07:24.623195 25823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.615058 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.3.6.61:42033)
0928 13:07:24.615092 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.615093 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.615101 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:07:24.615141 (+    40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.615142 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.615150 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.615207 (+    57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.615791 (+   584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.616435 (+   644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.617316 (+   881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.617560 (+   244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.617644 (+    84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.619973 (+  2329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.619974 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.619974 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.619982 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.621770 (+  1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.622172 (+   402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.622174 (+     2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.622174 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.622244 (+    70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.622471 (+   227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.622472 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.622473 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.622616 (+   143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.622774 (+   158us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.622997 (+   223us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.623095 (+    98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 13:07:24.624176 25894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: Bootstrap starting.
I20260928 13:07:24.624897 25894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:24.625211 25894 log.cc:824] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: Log is configured to *not* fsync() on all Append() calls
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.62@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:07:24.626142 25894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: No bootstrap required, opened a new log
I20260928 13:07:24.626416  3096 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 13:07:24.627658 25718 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "2e39da680b444105a1555773c17c4ce9"
 from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49652
I20260928 13:07:24.628499 25894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.628646 25894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bf93eb2e60646939960458377652516, State: Initialized, Role: FOLLOWER
I20260928 13:07:24.628744 25894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.629031 25901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.629091 25894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:24.629144 25901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.629345 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.621134 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55886)
0928 13:07:24.621174 (+    40us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.621185 (+    11us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.621221 (+    36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.621510 (+   289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.621511 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.621655 (+   144us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.621689 (+    34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.621691 (+     2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.623129 (+  1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.623131 (+     2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.623898 (+   767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.623901 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.624452 (+   551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.624455 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.624504 (+    49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.624943 (+   439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.624948 (+     5us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.626287 (+  1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.628104 (+  1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.628106 (+     2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.628106 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.628284 (+   178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.628506 (+   222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.628507 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.628507 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.628566 (+    59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.629072 (+   506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.629073 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.629122 (+    49us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.629175 (+    53us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.629275 (+   100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260928 13:07:24.629752 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.621233 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55886 (local address 127.3.6.60:41677)
0928 13:07:24.621398 (+   165us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.621400 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.621405 (+     5us) server_negotiation.cc:407] Connection header received
0928 13:07:24.621419 (+    14us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.621419 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.621427 (+     8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.621501 (+    74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.621770 (+   269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.623002 (+  1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.624103 (+  1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.624387 (+   284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.624454 (+    67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.626383 (+  1929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.626384 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.626384 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.626390 (+     6us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.627997 (+  1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.628372 (+   375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.628373 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.628374 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.628437 (+    63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.628769 (+   332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.628770 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.628770 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.628967 (+   197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.629467 (+   500us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.629511 (+    44us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.629613 (+   102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":116,"threads_started":1}
W20260928 13:07:24.631044 25912 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:24.631104 25912 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:24.631639 25744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9: Bootstrap starting.
I20260928 13:07:24.632356 25744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:24.632702 25744 log.cc:824] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:24.633525 25744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9: No bootstrap required, opened a new log
I20260928 13:07:24.634909 25744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.635100 25744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e39da680b444105a1555773c17c4ce9, State: Initialized, Role: FOLLOWER
I20260928 13:07:24.635196 25744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.635547 25718 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260928 13:07:24.633252 25826 master_runner.cc:186] Error getting master registration for 127.3.6.62:42981: OK, instance_id { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" instance_seqno: 1790600844276741 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:07:24.635506 25744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:24.635663 25718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:24.635689 25826 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:07:24.636492 25718 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.636734 25718 leader_election.cc:288] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [CANDIDATE]: Term 1 election: Requested vote from peers 6a24a9bd62db4849bf46325c69f68dec (127.3.6.61:42033), 1bf93eb2e60646939960458377652516 (127.3.6.60:41677)
I20260928 13:07:24.637172 25868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e39da680b444105a1555773c17c4ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1bf93eb2e60646939960458377652516"
I20260928 13:07:24.637306 25868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:24.638623 25868 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e39da680b444105a1555773c17c4ce9 in term 1.
I20260928 13:07:24.635505 25915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.639094 25915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.638898 25692 leader_election.cc:302] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bf93eb2e60646939960458377652516, 2e39da680b444105a1555773c17c4ce9; no voters: 
I20260928 13:07:24.639642 25915 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 13:07:24.639812 25915 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 2e39da680b444105a1555773c17c4ce9, State: Running, Role: LEADER
I20260928 13:07:24.639909 25915 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.640362 25915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e39da680b444105a1555773c17c4ce9. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.640441 25915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:24.640277 25676 master_runner.cc:186] Error getting master registration for 127.3.6.61:42033: OK, instance_id { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" instance_seqno: 1790600844424628 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 13:07:24.643515 25676 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 13:07:24.644114 25936 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 13:07:24.644644 25936 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 13:07:24.646695 25868 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [term 1 FOLLOWER]: Refusing update from remote peer 2e39da680b444105a1555773c17c4ce9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:07:24.647161 25915 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:07:24.648897 25901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e39da680b444105a1555773c17c4ce9. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.649019 25901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.649225 25746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.638386 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49658 (local address 127.3.6.62:42981)
0928 13:07:24.638469 (+    83us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.638472 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.639297 (+   825us) server_negotiation.cc:407] Connection header received
0928 13:07:24.639437 (+   140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.639438 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.639448 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.639478 (+    30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.640659 (+  1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.641420 (+   761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.642433 (+  1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.642732 (+   299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.642773 (+    41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.645530 (+  2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.645531 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.645532 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.645539 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.647303 (+  1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.648021 (+   718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.648022 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.648022 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.648099 (+    77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.648431 (+   332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.648432 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.648433 (+     1us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.648585 (+   152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.648664 (+    79us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.649038 (+   374us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.649125 (+    87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260928 13:07:24.652350 25938 mvcc.cc:205] Tried to move back new op lower bound from 7334301059668246528 to 7334301059645943808. Current Snapshot: MvccSnapshot[applied={T|T < 7334301059668246528}]
I20260928 13:07:24.652644 25915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.652733 25915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: This master's current role is: LEADER
I20260928 13:07:24.652793 25936 catalog_manager.cc:1347] Generated new cluster ID: 1138bfbfa8c14a9388e199e626866492
I20260928 13:07:24.652837 25936 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 13:07:24.653304 25939 mvcc.cc:205] Tried to move back new op lower bound from 7334301059668246528 to 7334301059645943808. Current Snapshot: MvccSnapshot[applied={T|T < 7334301059668246528}]
I20260928 13:07:24.659063 25901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.659192 25901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.659578 25819 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } attempt: 3
I20260928 13:07:24.662190 25899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.639572 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55894 (local address 127.3.6.60:41677)
0928 13:07:24.639613 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.639615 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.643155 (+  3540us) server_negotiation.cc:407] Connection header received
0928 13:07:24.643263 (+   108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.643264 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.643276 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.643324 (+    48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.644072 (+   748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.644822 (+   750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.645802 (+   980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.646144 (+   342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.646191 (+    47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.651840 (+  5649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.651841 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.651842 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.651849 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.653980 (+  2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.660827 (+  6847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.660828 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.660828 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.660900 (+    72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.661360 (+   460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.661361 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.661361 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.661494 (+   133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.661595 (+   101us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.661991 (+   396us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.662095 (+   104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 13:07:24.664248 25823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.638519 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.3.6.61:42033)
0928 13:07:24.638594 (+    75us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.638596 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.640696 (+  2100us) server_negotiation.cc:407] Connection header received
0928 13:07:24.640789 (+    93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.640790 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.640801 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.640829 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.641521 (+   692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.642240 (+   719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.643209 (+   969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.643500 (+   291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.643577 (+    77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.651877 (+  8300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.651879 (+     2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.651879 (+     0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.651887 (+     8us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.654770 (+  2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.661114 (+  6344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.661115 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.661115 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.661165 (+    50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.661817 (+   652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.661818 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.661818 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.663445 (+  1627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.663544 (+    99us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.664081 (+   537us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.664155 (+    74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1455,"server-negotiator.queue_time_us":45}
Sep 28 13:07:24 dist-test-slave-ddvw krb5kdc[25663](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790600844, etypes {rep=17 tkt=17 ses=17}, kudu/127.3.6.61@KRBTEST.COM for kudu/127.3.6.60@KRBTEST.COM
I20260928 13:07:24.669059 25821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.659833 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.3.6.60:41677 (local address 127.0.0.1:55910)
0928 13:07:24.659936 (+   103us) negotiation.cc:107] Waiting for socket to connect
0928 13:07:24.659948 (+    12us) client_negotiation.cc:174] Beginning negotiation
0928 13:07:24.659992 (+    44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 13:07:24.660174 (+   182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 13:07:24.660175 (+     1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 13:07:24.660344 (+   169us) client_negotiation.cc:189] Negotiated authn=SASL
0928 13:07:24.660395 (+    51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.660396 (+     1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.661263 (+   867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.661263 (+     0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.662627 (+  1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 13:07:24.662630 (+     3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.663578 (+   948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.663581 (+     3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 13:07:24.663646 (+    65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.664581 (+   935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 13:07:24.664585 (+     4us) client_negotiation.cc:656] calling sasl_client_start()
0928 13:07:24.666006 (+  1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 13:07:24.668035 (+  2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.668036 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.668036 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.668234 (+   198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.668455 (+   221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 13:07:24.668456 (+     1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 13:07:24.668456 (+     0us) client_negotiation.cc:760] calling sasl_client_step()
0928 13:07:24.668525 (+    69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 13:07:24.668779 (+   254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 13:07:24.668780 (+     1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 13:07:24.668822 (+    42us) client_negotiation.cc:769] Sending connection context
0928 13:07:24.668878 (+    56us) client_negotiation.cc:240] Negotiation successful
0928 13:07:24.668962 (+    84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260928 13:07:24.669075 25897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:24.659893 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.3.6.60:41677)
0928 13:07:24.659944 (+    51us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.659946 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.660054 (+   108us) server_negotiation.cc:407] Connection header received
0928 13:07:24.660076 (+    22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.660076 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.660085 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.660130 (+    45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.660460 (+   330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.661176 (+   716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.662939 (+  1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:24.663256 (+   317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:24.663315 (+    59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:24.666107 (+  2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 13:07:24.666108 (+     1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 13:07:24.666109 (+     1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 13:07:24.666116 (+     7us) server_negotiation.cc:922] calling sasl_server_start()
0928 13:07:24.667963 (+  1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.668326 (+   363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.668327 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.668327 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.668391 (+    64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 13:07:24.668571 (+   180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 13:07:24.668572 (+     1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 13:07:24.668572 (+     0us) server_negotiation.cc:967] calling sasl_server_step()
0928 13:07:24.668705 (+   133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 13:07:24.668778 (+    73us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:24.668901 (+   123us) server_negotiation.cc:299] Negotiation successful
0928 13:07:24.668981 (+    80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 13:07:24.671144 25819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: Bootstrap starting.
I20260928 13:07:24.671967 25819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: Neither blocks nor log segments found. Creating new log.
I20260928 13:07:24.672284 25819 log.cc:824] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: Log is configured to *not* fsync() on all Append() calls
I20260928 13:07:24.673511 25936 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 13:07:24.674250 25936 catalog_manager.cc:1504] Loading token signing keys...
I20260928 13:07:24.679352 25819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: No bootstrap required, opened a new log
I20260928 13:07:24.681381 25819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.681535 25819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a24a9bd62db4849bf46325c69f68dec, State: Initialized, Role: FOLLOWER
I20260928 13:07:24.681619 25819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } }
I20260928 13:07:24.681946 25819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: configured and running, proceeding with master startup.
I20260928 13:07:24.682003 25793 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2e39da680b444105a1555773c17c4ce9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6a24a9bd62db4849bf46325c69f68dec"
I20260928 13:07:24.682093 25792 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [term 0 FOLLOWER]: Advancing to term 1
I20260928 13:07:24.681974 25945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.682368 25945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.682976 25792 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [term 1 FOLLOWER]: Refusing update from remote peer 2e39da680b444105a1555773c17c4ce9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 13:07:24.683317 25934 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 13:07:24.683890 25793 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e39da680b444105a1555773c17c4ce9 in term 1.
I20260928 13:07:24.684517 25936 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9: Generated new TSK 0
I20260928 13:07:24.684727 25936 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 13:07:24.687500 25945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e39da680b444105a1555773c17c4ce9. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.687588 25945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.687625 25945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.687678 25945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec [sys.catalog]: This master's current role is: FOLLOWER
I20260928 13:07:24.688506 25942 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2e39da680b444105a1555773c17c4ce9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e39da680b444105a1555773c17c4ce9" member_type: VOTER last_known_addr { host: "127.3.6.62" port: 42981 } } peers { permanent_uuid: "6a24a9bd62db4849bf46325c69f68dec" member_type: VOTER last_known_addr { host: "127.3.6.61" port: 42033 } } peers { permanent_uuid: "1bf93eb2e60646939960458377652516" member_type: VOTER last_known_addr { host: "127.3.6.60" port: 41677 } } }
I20260928 13:07:24.688624 25942 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e39da680b444105a1555773c17c4ce9 [sys.catalog]: This master's current role is: LEADER
W20260928 13:07:24.689270 25956 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 13:07:24.689371 25956 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 13:07:24.689548 25957 mvcc.cc:205] Tried to move back new op lower bound from 7334301059804999680 to 7334301059645943808. Current Snapshot: MvccSnapshot[applied={T|T < 7334301059668246528}]
W20260928 13:07:24.709779 25746 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.708165 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49674 (local address 127.3.6.62:42981)
0928 13:07:24.708211 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.708213 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.709133 (+   920us) server_negotiation.cc:407] Connection header received
0928 13:07:24.709243 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.709244 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.709255 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.709286 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.709713 (+   427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49674: BlockingRecv error: recv got EOF from 127.0.0.1:49674 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260928 13:07:24.710500 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.708583 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41532 (local address 127.3.6.61:42033)
0928 13:07:24.708622 (+    39us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.708623 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.710022 (+  1399us) server_negotiation.cc:407] Connection header received
0928 13:07:24.710116 (+    94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.710117 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.710126 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.710154 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.710439 (+   285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41532: BlockingRecv error: recv got EOF from 127.0.0.1:41532 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260928 13:07:24.711207 25897 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.708876 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.3.6.60:41677)
0928 13:07:24.708913 (+    37us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.708915 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.710678 (+  1763us) server_negotiation.cc:407] Connection header received
0928 13:07:24.710795 (+   117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.710796 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.710806 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.710834 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.711148 (+   314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55916: BlockingRecv error: recv got EOF from 127.0.0.1:55916 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 13:07:24.715727 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.712362 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41542 (local address 127.3.6.61:42033)
0928 13:07:24.712403 (+    41us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.712405 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.715203 (+  2798us) server_negotiation.cc:407] Connection header received
0928 13:07:24.715313 (+   110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.715314 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.715332 (+    18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.715360 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.715677 (+   317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41542: BlockingRecv error: recv got EOF from 127.0.0.1:41542 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 13:07:24.718636 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.717920 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41552 (local address 127.3.6.61:42033)
0928 13:07:24.717953 (+    33us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.717955 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.718169 (+   214us) server_negotiation.cc:407] Connection header received
0928 13:07:24.718261 (+    92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.718262 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.718271 (+     9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.718299 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.718589 (+   290us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41552: BlockingRecv error: recv got EOF from 127.0.0.1:41552 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260928 13:07:24.722441 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.721734 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41568 (local address 127.3.6.61:42033)
0928 13:07:24.721768 (+    34us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.721770 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.721959 (+   189us) server_negotiation.cc:407] Connection header received
0928 13:07:24.722066 (+   107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.722067 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.722078 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.722107 (+    29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.722395 (+   288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41568: BlockingRecv error: recv got EOF from 127.0.0.1:41568 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260928 13:07:24.728340 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.727601 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.3.6.61:42033)
0928 13:07:24.727636 (+    35us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.727638 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.727837 (+   199us) server_negotiation.cc:407] Connection header received
0928 13:07:24.727930 (+    93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.727931 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.727941 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.727969 (+    28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.728293 (+   324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41582: BlockingRecv error: recv got EOF from 127.0.0.1:41582 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 13:07:24.738777 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.737747 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41586 (local address 127.3.6.61:42033)
0928 13:07:24.737792 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.737795 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.738159 (+   364us) server_negotiation.cc:407] Connection header received
0928 13:07:24.738271 (+   112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.738272 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.738285 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.738316 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.738705 (+   389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41586: BlockingRecv error: recv got EOF from 127.0.0.1:41586 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260928 13:07:24.757304 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.756336 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41600 (local address 127.3.6.61:42033)
0928 13:07:24.756380 (+    44us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.756383 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.756675 (+   292us) server_negotiation.cc:407] Connection header received
0928 13:07:24.756790 (+   115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.756792 (+     2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.756804 (+    12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.756835 (+    31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.757246 (+   411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41600: BlockingRecv error: recv got EOF from 127.0.0.1:41600 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 13:07:24.791813 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.790790 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41602 (local address 127.3.6.61:42033)
0928 13:07:24.790836 (+    46us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.790838 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.791161 (+   323us) server_negotiation.cc:407] Connection header received
0928 13:07:24.791272 (+   111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.791273 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.791286 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.791318 (+    32us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.791749 (+   431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41602: BlockingRecv error: recv got EOF from 127.0.0.1:41602 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 13:07:24.858031 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.857288 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41612 (local address 127.3.6.61:42033)
0928 13:07:24.857360 (+    72us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.857363 (+     3us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.857469 (+   106us) server_negotiation.cc:407] Connection header received
0928 13:07:24.857524 (+    55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.857525 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.857542 (+    17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.857624 (+    82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.857965 (+   341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41612: BlockingRecv error: recv got EOF from 127.0.0.1:41612 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260928 13:07:24.988281 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:24.987510 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.3.6.61:42033)
0928 13:07:24.987587 (+    77us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:24.987589 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:24.987704 (+   115us) server_negotiation.cc:407] Connection header received
0928 13:07:24.987757 (+    53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:24.987758 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:24.987769 (+    11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:24.987823 (+    54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:24.988216 (+   393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41628: BlockingRecv error: recv got EOF from 127.0.0.1:41628 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260928 13:07:25.246120 25823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 13:07:25.245453 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41638 (local address 127.3.6.61:42033)
0928 13:07:25.245520 (+    67us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.245522 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.245556 (+    34us) server_negotiation.cc:407] Connection header received
0928 13:07:25.245619 (+    63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.245619 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.245629 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.245682 (+    53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 13:07:25.246073 (+   391us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41638: BlockingRecv error: recv got EOF from 127.0.0.1:41638 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 13:07:25.631551 25912 catalog_manager.cc:1259] Loaded cluster ID: 1138bfbfa8c14a9388e199e626866492
I20260928 13:07:25.631632 25912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: loading cluster ID for follower catalog manager: success
I20260928 13:07:25.632437 25912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: acquiring CA information for follower catalog manager: success
I20260928 13:07:25.632699 25912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1bf93eb2e60646939960458377652516: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:07:25.689839 25956 catalog_manager.cc:1259] Loaded cluster ID: 1138bfbfa8c14a9388e199e626866492
I20260928 13:07:25.689926 25956 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: loading cluster ID for follower catalog manager: success
I20260928 13:07:25.690850 25956 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: acquiring CA information for follower catalog manager: success
I20260928 13:07:25.691186 25956 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6a24a9bd62db4849bf46325c69f68dec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 13:07:25.762193 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:25.759506 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41650 (local address 127.3.6.61:42033)
0928 13:07:25.759652 (+   146us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.759653 (+     1us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.759667 (+    14us) server_negotiation.cc:407] Connection header received
0928 13:07:25.759790 (+   123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.759791 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.759840 (+    49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.759917 (+    77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:25.760083 (+   166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.760626 (+   543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.761450 (+   824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.761649 (+   199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.761704 (+    55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:25.761855 (+   151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:25.761966 (+   111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:25.762028 (+    62us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:25.762070 (+    42us) server_negotiation.cc:299] Negotiation successful
0928 13:07:25.762088 (+    18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":65,"threads_started":1}
I20260928 13:07:25.766530 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:25.764191 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55918 (local address 127.3.6.60:41677)
0928 13:07:25.764299 (+   108us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.764301 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.764309 (+     8us) server_negotiation.cc:407] Connection header received
0928 13:07:25.764343 (+    34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.764343 (+     0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.764375 (+    32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.764453 (+    78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:25.764543 (+    90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.765048 (+   505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.765727 (+   679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.765961 (+   234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.766018 (+    57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:25.766139 (+   121us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:25.766236 (+    97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:25.766293 (+    57us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:25.766389 (+    96us) server_negotiation.cc:299] Negotiation successful
0928 13:07:25.766406 (+    17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":63,"threads_started":1}
I20260928 13:07:25.771364 26034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:25.768571 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55932 (local address 127.3.6.60:41677)
0928 13:07:25.768624 (+    53us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.768626 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.768777 (+   151us) server_negotiation.cc:407] Connection header received
0928 13:07:25.768874 (+    97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.768875 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.768885 (+    10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.768914 (+    29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:25.769080 (+   166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.769767 (+   687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.770521 (+   754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.770799 (+   278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.770859 (+    60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:25.771083 (+   224us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:25.771119 (+    36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:25.771172 (+    53us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:25.771256 (+    84us) server_negotiation.cc:299] Negotiation successful
0928 13:07:25.771276 (+    20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 13:07:25.771791 26028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:25.768326 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41652 (local address 127.3.6.61:42033)
0928 13:07:25.768371 (+    45us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.768377 (+     6us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.768708 (+   331us) server_negotiation.cc:407] Connection header received
0928 13:07:25.768776 (+    68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.768777 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.768790 (+    13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.768839 (+    49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:25.768991 (+   152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.769732 (+   741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.770710 (+   978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.770987 (+   277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.771198 (+   211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:25.771371 (+   173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:25.771404 (+    33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:25.771434 (+    30us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:25.771693 (+   259us) server_negotiation.cc:299] Negotiation successful
0928 13:07:25.771718 (+    25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 13:07:25.772107 26041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 13:07:25.768425 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49676 (local address 127.3.6.62:42981)
0928 13:07:25.768565 (+   140us) server_negotiation.cc:206] Beginning negotiation
0928 13:07:25.768567 (+     2us) server_negotiation.cc:399] Waiting for connection header
0928 13:07:25.768610 (+    43us) server_negotiation.cc:407] Connection header received
0928 13:07:25.768728 (+   118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 13:07:25.768729 (+     1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 13:07:25.768783 (+    54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 13:07:25.768863 (+    80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 13:07:25.769091 (+   228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.769577 (+   486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.770664 (+  1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 13:07:25.771087 (+   423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 13:07:25.771168 (+    81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 13:07:25.771648 (+   480us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 13:07:25.771802 (+   154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 13:07:25.771883 (+    81us) server_negotiation.cc:1035] Waiting for connection context
0928 13:07:25.771979 (+    96us) server_negotiation.cc:299] Negotiation successful
0928 13:07:25.772006 (+    27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":69,"threads_started":1}
I20260928 13:07:25.777755  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25676
I20260928 13:07:25.783308  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25751
I20260928 13:07:25.788549  3096 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasktCerZp/build/release/bin/kudu with pid 25826
2026-09-28T13:07:25Z chronyd exiting
[       OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2784 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5587 ms total)

[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (269366 ms total)
[  PASSED  ] 55 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] SecurityITest.TestJwtMiniCluster

 1 FAILED TEST